00000001:02000400:2.0F:1782480512.118887:0:2969:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_hostid 00000001:02000400:2.0:1782480533.570626:0:3192:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1782480535.310438:0:3255:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 655 MB/s 00000001:01000000:1.0F:1782480535.561152:0:3255:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 450 MB/s 00000001:01000000:2.0:1782480535.814618:0:3255:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5158 MB/s 00000020:02000000:0.0:1782480536.528679:0:3284:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_95_ga6f956b 00000400:02000000:2.0:1782480537.639336:0:3299:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.204.151@tcp [8/256/0/180] 00008000:02000000:2.0:1782480541.289688:0:3449:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1782480586.376054:0:5251:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing load_modules_local 00000020:01000004:3.0F:1782480595.600237:0:5788:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782480595.600251:0:5788:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1782480595.600366:0:5788:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000006263253 00000080:02000400:3.0:1782480595.600379:0:5788:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1782480595.604644:0:5788:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1782480595.604661:0:5788:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1782480595.605080:0:5788:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000f538f7c2) 00000020:00000080:3.0:1782480595.605104:0:5788:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1782480595.619083:0:5788:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1782480595.619591:0:5788:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1782480595.642623:0:5788:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1782480595.642666:0:5788:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1782480595.642684:0:5788:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1782480595.642728:0:5788:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1782480595.642778:0:5788:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1782480595.644497:0:5788:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1782480595.644505:0:5788:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782480595.644518:0:5788:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3dc3ebf33c0236ee 00000020:01000004:2.0:1782480595.644526:0:5788:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1782480595.644530:0:5788:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1782480595.644533:0:5788:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000006263253 from MGS 00000020:01000004:2.0:1782480595.644537:0:5788:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1782480595.644558:0:5788:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000005a0c4587) 00000020:00000080:2.0:1782480595.644567:0:5788:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1782480595.644681:0:5788:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000006263253 from MGS, refs=2 00080000:01000000:2.0:1782480595.644687:0:5788:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782480595.644692:0:5788:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3dc3ebf33c0236fc 00000100:00100000:2.0:1782480595.644826:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1782480595.645099:0:5788:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1782480595.645108:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1782480595.645866:0:5788:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1782480595.645874:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1782480595.646643:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782480595.647025:0:5788:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1782480595.647032:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1782480595.647591:0:5788:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1782480595.647603:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1782480595.648077:0:5788:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1782480595.648083:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1782480595.648661:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480595.648664:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480595.648665:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480595.649213:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480595.649215:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480595.649216:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480595.649840:0:5788:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1782480595.653515:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1782480595.898854:0:5788:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3275 MB/s 00000001:01000000:2.0:1782480596.148824:0:5788:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2483 MB/s 00000001:01000000:0.0:1782480596.399839:0:5788:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 462 MB/s 00000001:01000000:0.0:1782480596.651441:0:5788:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 446 MB/s 00010000:00010000:2.0:1782480596.664386:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1782480596.671895:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1782480596.718336:0:5788:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1782480596.718364:0:5788:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1782480596.718367:0:5788:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1782480596.720025:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1782480596.720100:0:5788:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1782480596.720253:0:5788:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1782480596.720538:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1782480596.720567:0:5788:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1782480596.720973:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782480596.721146:0:5788:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1782480596.721153:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1782480596.726297:0:5788:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1782480596.726311:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1782480596.727326:0:5788:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1782480596.727334:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1782480596.727983:0:5788:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1782480596.728003:0:5788:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.204.151@tcp' 00000020:01000004:3.0:1782480596.728006:0:5788:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1782480596.728056:0:5788:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.204.151@tcp (typ=mgc) 00000020:00000080:3.0:1782480596.728069:0:5788:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.151@tcp (00000000a0bf5413) 00000020:00000080:3.0:1782480596.728089:0:5788:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1782480596.728193:0:5788:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f366e8f5@MGC192.168.204.151@tcp: add connection 192.168.204.151@tcp at head 00010000:00010000:3.0:1782480596.728375:0:5788:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.151@tcp-0 is initialized 00000040:01000000:3.0:1782480596.728383:0:5788:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 1 is initialized 00000100:00080000:0.0:1782480596.728672:0:5803:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1782480596.736536:0:5804:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1782480596.740366:0:5788:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.151@tcp (uuid 7fffafe6-aedd-4500-93d4-974eea0c11af) 00000020:00000080:0.0:1782480596.740397:0:5788:0:(genops.c:1406:class_connect()) connect: client 7fffafe6-aedd-4500-93d4-974eea0c11af, cookie 0x3dc3ebf33c02370a 00000100:00080000:0.0:1782480596.740410:0:5788:0:(import.c:512:import_select_connection()) MGC192.168.204.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782480596.740416:0:5788:0:(import.c:626:import_select_connection()) MGC192.168.204.151@tcp: import 00000000f366e8f5 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1782480596.740480:0:5788:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fd0820cf x1869066311565440/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782480596.740505:0:5788:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 7fffafe6-aedd-4500-93d4-974eea0c11af->MGS 00000020:01000004:0.0:1782480596.740525:0:5788:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1782480596.740531:0:5788:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1782480596.740554:0:5788:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000de9e208e) 00000020:00000080:0.0:1782480596.740567:0:5788:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1782480596.741419:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000fd0820cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7fffafe6-aedd-4500-93d4-974eea0c11af:3314:1869066311565440:0@lo:250: 00000100:00100000:2.0:1782480596.741538:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480596.743845:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311565440 00000100:00100000:3.0:1782480596.743861:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311565440 00000100:00100000:3.0:1782480596.743911:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782480596.743919:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000006371c6e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3314:x1869066311565440:12345-0@lo:250: 00010000:00080000:3.0:1782480596.743956:0:5799:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 7fffafe6-aedd-4500-93d4-974eea0c11af@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:3.0:1782480596.743992:0:5799:0:(genops.c:1406:class_connect()) connect: client 7fffafe6-aedd-4500-93d4-974eea0c11af, cookie 0x3dc3ebf33c023718 00000100:00080000:3.0:1782480596.744210:0:5799:0:(import.c:65:import_set_state_nolock()) 00000000cda24618 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782480596.744293:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000006371c6e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+5:3314:x1869066311565440:12345-0@lo:250: Request processed in 374us (2756us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480596.744301:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782480596.745805:0:3314:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1782480596.745818:0:3314:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.151@tcp: connect to target with instance 0 00000100:00080000:2.0:1782480596.745827:0:3314:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1782480596.745832:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1782480596.745836:0:3314:0:(import.c:65:import_set_state_nolock()) 00000000f366e8f5 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1782480596.745839:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1782480596.745855:0:3314:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1782480596.745861:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000fd0820cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7fffafe6-aedd-4500-93d4-974eea0c11af:3314:1869066311565440:0@lo:250: 00000100:00100000:0.0:1782480596.774677:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782480596.774985:0:5788:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1782480596.775001:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1782480596.776353:0:5788:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1782480596.776361:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1782480596.777912:0:5788:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1782480596.777926:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1782480596.778709:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782480596.780108:0:5788:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1782480596.780118:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1782480596.784140:0:5788:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1782480596.784154:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1782480596.841687:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782480596.841936:0:5788:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1782480596.841942:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1782480596.849829:0:5788:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1782480596.849852:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1782480596.851045:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782480596.851248:0:5788:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782480596.851254:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1782480596.852388:0:5788:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1782480596.852399:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1782480596.853973:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782480596.854165:0:5788:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782480596.854171:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1782480596.864675:0:5788:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1782480596.864701:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1782480596.866947:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782480596.867125:0:5788:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782480596.867142:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1782480596.875139:0:5788:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782480596.875157:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1782480596.903078:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782480596.903707:0:5788:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1782480596.903723:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1782480596.906972:0:5788:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1782480596.906998:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1782480596.914526:0:5788:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1782480596.914544:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1782480596.916444:0:5788:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1782480596.916468:0:5788:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1782480596.916474:0:5788:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1782480596.916599:0:5788:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782480596.916631:0:5788:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.151@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1782480596.916636:0:5788:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782480596.916637:0:5788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782480596.916638:0:5788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782480596.916640:0:5788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782480596.916641:0:5788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782480596.916642:0:5788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782480596.916644:0:5788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782480596.916645:0:5788:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782480596.916647:0:5788:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782480596.916648:0:5788:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782480596.916649:0:5788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782480596.916650:0:5788:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782480596.916653:0:5788:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1782480596.916661:0:5788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782480596.916662:0:5788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782480596.916663:0:5788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782480596.916664:0:5788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782480596.916664:0:5788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782480596.916665:0:5788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782480596.916666:0:5788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782480596.916667:0:5788:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782480596.916667:0:5788:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782480596.916668:0:5788:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782480596.916669:0:5788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782480596.916670:0:5788:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782480596.916696:0:5788:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1782480596.916711:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005921dfba pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311565568:0@lo:253: 00000100:00100000:0.0:1782480596.917469:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480596.918521:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set 0000000085a337ab going to sleep for 11 seconds 00000100:00100000:1.0:1782480596.922388:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311565568 00000100:00100000:1.0:1782480596.922403:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311565568 00000100:00100000:1.0:1782480596.922513:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782480596.922524:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000780b3889 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+5:5788:x1869066311565568:12345-0@lo:253: 20000000:01000000:1.0:1782480596.922578:0:5802:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1782480596.922582:0:5802:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1782480596.922957:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1782480596.923025:0:5802:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1782480596.923349:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782480596.924536:0:5824:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1782480596.928411:0:5802:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1782480596.928419:0:5802:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1782480596.928425:0:5802:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1782480596.928442:0:5802:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1782480596.928463:0:5802:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1782480596.928712:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782480596.929590:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1782480596.929613:0:5802:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1782480596.929667:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1782480596.929716:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1782480596.930482:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1782480596.930641:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1782480596.930650:0:5802:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1782480596.930705:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1782480596.930712:0:5802:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1782480596.930744:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1782480596.931421:0:5802:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1782480596.931479:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1782480596.931573:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1782480596.931629:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1782480596.931635:0:5802:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1782480596.931650:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782480596.932632:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1782480596.932652:0:5802:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1782480596.932696:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1782480596.932730:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1782480596.933502:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1782480596.933526:0:5802:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1782480596.933644:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1782480596.933655:0:5802:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1782480596.933703:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1782480596.936626:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1782480596.936688:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1782480596.936710:0:5802:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1782480596.937544:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1782480596.937577:0:5802:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1782480596.937615:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1782480596.937648:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1782480596.938320:0:5802:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1782480596.938381:0:5802:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1782480596.938390:0:5802:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1782480596.939190:0:5825:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1782480596.939562:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1782480596.939589:0:5802:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.151@tcp for mdt 20000000:01000000:1.0:1782480596.939591:0:5802:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:1.0:1782480596.939625:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1782480596.939633:0:5802:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1782480596.939662:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1782480596.939670:0:5802:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:1.0:1782480596.939715:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1782480596.939725:0:5802:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1782480596.939831:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1782480596.939870:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1782480596.939945:0:5802:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1782480596.939950:0:5802:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1782480596.939956:0:5802:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1782480596.939962:0:5802:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1782480596.943608:0:5826:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1782480596.943861:0:5802:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1782480596.954321:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1782480596.954450:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1782480596.954537:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1782480596.954554:0:5802:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1782480596.954556:0:5802:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1782480596.954559:0:5802:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1782480596.954584:0:5802:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1782480596.954587:0:5802:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1782480596.954618:0:5802:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1782480596.954621:0:5802:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1782480596.956661:0:5827:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1782480596.957612:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1782480596.957659:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1782480596.957689:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1782480596.957701:0:5802:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1782480596.957703:0:5802:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1782480596.958598:0:5828:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1782480596.960020:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1782480596.960080:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1782480596.960166:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:1.0:1782480596.960182:0:5802:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782480596.960185:0:5802:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1782480596.960192:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782480596.960278:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b4c69eb4/0x3dc3ebf33c02371f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480596.960296:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b4c69eb4/0x3dc3ebf33c02371f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480596.960323:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b4c69eb4/0x3dc3ebf33c02371f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480596.960388:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b4c69eb4/0x3dc3ebf33c02371f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480596.960395:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b4c69eb4/0x3dc3ebf33c02371f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480596.960401:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b4c69eb4/0x3dc3ebf33c02371f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480596.960407:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b4c69eb4 already unused, calling callback (00000000eb73381f) 00010000:00010000:1.0:1782480596.960410:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b4c69eb4/0x3dc3ebf33c02371f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480596.960418:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b4c69eb4/0x3dc3ebf33c02371f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480596.960430:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b4c69eb4/0x3dc3ebf33c02371f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480596.960438:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b4c69eb4/0x3dc3ebf33c02371f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480596.960444:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b4c69eb4/0x3dc3ebf33c02371f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782480596.960466:0:5802:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1782480597.223902:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000780b3889 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+5:5788:x1869066311565568:12345-0@lo:253: Request processed in 301372us (306427us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480597.223948:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782480597.224136:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005921dfba pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311565568:0@lo:253: 10000000:01000000:0.0:1782480597.224153:0:5788:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1782480597.224156:0:5788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782480597.224158:0:5788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782480597.224159:0:5788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782480597.224160:0:5788:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1782480597.224162:0:5788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782480597.224163:0:5788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782480597.224164:0:5788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782480597.224166:0:5788:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782480597.224167:0:5788:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1782480597.224168:0:5788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782480597.224170:0:5788:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782480597.224190:0:5788:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000006263253 from lustre-MDT0000 10000000:01000000:0.0:1782480597.224215:0:5788:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1782480597.224218:0:5788:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1782480597.224223:0:5788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b6d4845cd40 10000000:01000000:0.0:1782480597.224227:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782480597.224234:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9b6d4845cd40 from 1 10000000:01000000:0.0:1782480597.224242:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782480597.224279:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 0000000009d52896/0x3dc3ebf33c023726 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.224289:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 0000000009d52896/0x3dc3ebf33c023726 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.224297:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 0000000009d52896/0x3dc3ebf33c023726 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480597.224315:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005921dfba pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311565696:0@lo:101: 00000100:00100000:0.0:1782480597.224362:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480597.224489:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311565696 00000100:00100000:3.0:1782480597.224496:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311565696 00000100:00100000:3.0:1782480597.224551:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782480597.224558:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000bb95752f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+5:5788:x1869066311565696:12345-0@lo:101: 00010000:00010000:3.0:1782480597.224571:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480597.224585:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000073727ab5/0x3dc3ebf33c02372d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023726 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480597.224607:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000073727ab5/0x3dc3ebf33c02372d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023726 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480597.224616:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000073727ab5/0x3dc3ebf33c02372d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023726 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480597.224625:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000073727ab5, rc 0) 00000100:00100000:3.0:1782480597.224656:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000bb95752f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+6:5788:x1869066311565696:12345-0@lo:101: Request processed in 99us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480597.224662:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782480597.224868:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a9f387ba going to sleep for 11 seconds 00000100:00100000:0.0:1782480597.224881:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005921dfba pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311565696:0@lo:101: 00010000:00010000:0.0:1782480597.224892:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 0000000009d52896/0x3dc3ebf33c023726 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02372d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.224900:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 0000000009d52896/0x3dc3ebf33c023726 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c02372d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480597.225018:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005921dfba pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311565824:0@lo:501: 00000100:00100000:0.0:1782480597.225045:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480597.225056:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a9f387ba going to sleep for 11 seconds 00000100:00100000:1.0:1782480597.225117:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311565824 00000100:00100000:1.0:1782480597.225132:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311565824 00000100:00100000:1.0:1782480597.225158:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782480597.225164:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000088b01dfd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+6:5788:x1869066311565824:12345-0@lo:501: 00000100:00100000:1.0:1782480597.225517:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000088b01dfd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+6:5788:x1869066311565824:12345-0@lo:501: Request processed in 352us (471us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782480597.225525:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782480597.225664:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005921dfba pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311565824:0@lo:501: 10000000:01000000:0.0:1782480597.225688:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782480597.225709:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 0000000009d52896/0x3dc3ebf33c023726 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02372d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.225717:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 0000000009d52896/0x3dc3ebf33c023726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02372d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480597.225734:0:5788:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b6d47c9a800 10000000:01000000:0.0:1782480597.225737:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1782480597.225742:0:5788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b6d47c9a800 10000000:01000000:0.0:1782480597.225744:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1782480597.225770:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9b6d47c9a800 from 1 10000000:01000000:0.0:1782480597.225772:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1782480597.225793:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 00000000e7a960ce/0x3dc3ebf33c023734 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.225800:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 00000000e7a960ce/0x3dc3ebf33c023734 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.225808:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 00000000e7a960ce/0x3dc3ebf33c023734 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480597.225820:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005921dfba pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311565952:0@lo:101: 00000100:00100000:0.0:1782480597.225846:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480597.225866:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a9f387ba going to sleep for 11 seconds 00000100:00100000:3.0:1782480597.226005:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311565952 00000100:00100000:3.0:1782480597.226010:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311565952 00000100:00100000:3.0:1782480597.226044:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782480597.226051:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000003e4620ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+6:5788:x1869066311565952:12345-0@lo:101: 00010000:00010000:3.0:1782480597.226061:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480597.226077:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000db61e2ae/0x3dc3ebf33c02373b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023734 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480597.226094:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000db61e2ae/0x3dc3ebf33c02373b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023734 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480597.226102:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000db61e2ae/0x3dc3ebf33c02373b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023734 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480597.226109:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000db61e2ae, rc 0) 00000100:00100000:3.0:1782480597.226151:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000003e4620ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+7:5788:x1869066311565952:12345-0@lo:101: Request processed in 101us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480597.226157:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782480597.226231:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005921dfba pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311565952:0@lo:101: 00010000:00010000:0.0:1782480597.226242:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 00000000e7a960ce/0x3dc3ebf33c023734 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02373b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.226249:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 00000000e7a960ce/0x3dc3ebf33c023734 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c02373b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480597.226260:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1782480597.226263:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 00000000e7a960ce/0x3dc3ebf33c023734 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02373b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.226278:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 00000000e7a960ce/0x3dc3ebf33c023734 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02373b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480597.226284:0:5788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1782480597.226287:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782480597.226291:0:5788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b6d47c9a800 10000000:01000000:0.0:1782480597.226293:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1782480597.226295:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1782480597.226297:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782480597.226311:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 0000000069d51d2a/0x3dc3ebf33c023742 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.226316:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 0000000069d51d2a/0x3dc3ebf33c023742 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.226323:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 0000000069d51d2a/0x3dc3ebf33c023742 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480597.226334:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005921dfba pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311566080:0@lo:101: 00000100:00100000:0.0:1782480597.226358:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480597.226379:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a9f387ba going to sleep for 11 seconds 00000100:00100000:3.0:1782480597.226575:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311566080 00000100:00100000:3.0:1782480597.226580:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311566080 00000100:00100000:3.0:1782480597.226613:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782480597.226619:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000e4940ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+7:5788:x1869066311566080:12345-0@lo:101: 00010000:00010000:3.0:1782480597.226626:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480597.226634:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f6d1b283/0x3dc3ebf33c023749 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023742 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480597.226646:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f6d1b283/0x3dc3ebf33c023749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023742 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480597.226654:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f6d1b283/0x3dc3ebf33c023749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023742 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480597.226661:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f6d1b283, rc 0) 00000100:00100000:3.0:1782480597.226689:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000e4940ad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+8:5788:x1869066311566080:12345-0@lo:101: Request processed in 71us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480597.226703:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782480597.226853:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005921dfba pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311566080:0@lo:101: 00010000:00010000:0.0:1782480597.226863:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 0000000069d51d2a/0x3dc3ebf33c023742 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023749 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.226870:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 0000000069d51d2a/0x3dc3ebf33c023742 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023749 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480597.227009:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005921dfba pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311566208:0@lo:501: 00000100:00100000:0.0:1782480597.227037:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480597.227065:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a9f387ba going to sleep for 11 seconds 00000100:00100000:3.0:1782480597.227117:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311566208 00000100:00100000:3.0:1782480597.227131:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311566208 00000100:00100000:3.0:1782480597.227162:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782480597.227168:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000adf86404 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+8:5788:x1869066311566208:12345-0@lo:501: 00000100:00100000:3.0:1782480597.227666:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000adf86404 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+9:5788:x1869066311566208:12345-0@lo:501: Request processed in 494us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480597.227674:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782480597.229159:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005921dfba pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311566208:0@lo:501: 00000100:00100000:1.0:1782480597.229368:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a37719e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311566336:0@lo:503: 00000100:00100000:1.0:1782480597.229983:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480597.230073:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set 00000000660c420b going to sleep for 11 seconds 00000100:00100000:0.0:1782480597.230146:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311566336 00000100:00100000:0.0:1782480597.230154:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311566336 00000100:00100000:0.0:1782480597.230249:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782480597.230257:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000003ad52a5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+9:5788:x1869066311566336:12345-0@lo:503: 00000100:00100000:0.0:1782480597.230707:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000003ad52a5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+9:5788:x1869066311566336:12345-0@lo:503: Request processed in 450us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480597.230716:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782480597.231031:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a37719e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311566336:0@lo:503: 00000100:00100000:3.0:1782480597.231630:0:5830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000051025995 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:5830:1869066311566464:0@lo:502: 00000100:00100000:3.0:1782480597.231683:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480597.231803:0:5830:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e622e0dd going to sleep for 11 seconds 00000100:00100000:0.0:1782480597.231907:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311566464 00000100:00100000:0.0:1782480597.231919:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311566464 00000100:00100000:1.0:1782480597.232083:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782480597.232093:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000bd832396 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+9:5830:x1869066311566464:12345-0@lo:502: 00000100:00100000:1.0:1782480597.232314:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000bd832396 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+9:5830:x1869066311566464:12345-0@lo:502: Request processed in 223us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480597.232323:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782480597.232407:0:5830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000051025995 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:5830:1869066311566464:0@lo:502: 00000020:01000000:3.0:1782480597.232438:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782480597.232453:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480597.232456:0:5830:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1782480597.232460:0:5830:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1782480597.232463:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782480597.232479:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000037ceb7ba) 00000020:00000080:3.0:1782480597.232513:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1782480597.232519:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1782480597.232617:0:5830:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1782480597.232625:0:5830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3dc3ebf33c023757 00000020:00000080:3.0:1782480597.232902:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1782480597.232907:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782480597.232910:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480597.232911:0:5830:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1782480597.232914:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782480597.232917:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480597.232923:0:5830:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1782480597.232927:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782480597.232934:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000006157ec53) 00000020:00000080:3.0:1782480597.232944:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1782480597.232948:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1782480597.232949:0:5830:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1782480597.232952:0:5830:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1782480597.232958:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782480597.233001:0:5830:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000006263253 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1782480597.233022:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000008c9f1b9d) 00000020:00000080:3.0:1782480597.233031:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1782480597.233090:0:5830:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1782480597.233095:0:5830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3dc3ebf33c02376c 00000020:00000080:3.0:1782480597.233193:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1782480597.233200:0:5830:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1782480597.233204:0:5830:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3dc3ebf33c023773 00080000:01000000:3.0:1782480597.233208:0:5830:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1782480597.233211:0:5830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3dc3ebf33c02377a 00080000:10000000:3.0:1782480597.233604:0:5830:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1782480597.233905:0:5830:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1782480597.238234:0:5830:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1782480597.309196:0:5830:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1782480597.309969:0:5830:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1782480597.312675:0:5830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1782480597.313198:0:5830:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1782480597.343377:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000b10009a9) 00000020:00000080:2.0:1782480597.343461:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1782480597.343666:0:5830:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1782480597.343673:0:5830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3dc3ebf33c023788 00000020:00000080:2.0:1782480597.345807:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1782480597.350304:0:5830:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782480597.386393:0:5830:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1782480597.409573:0:5830:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480597.441070:0:5830:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480597.492578:0:5830:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1782480597.541712:0:5830:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1782480597.588642:0:5830:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3dc3ebf33c02378f 00000020:00000080:2.0:1782480597.589132:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1782480597.589143:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480597.589149:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480597.589151:0:5830:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1782480597.589154:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782480597.589160:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480597.589161:0:5830:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1782480597.589165:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1782480597.589200:0:5830:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1782480597.589211:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480597.589214:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480597.589215:0:5830:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1782480597.589218:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782480597.589227:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480597.589228:0:5830:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782480597.589232:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782480597.589233:0:5830:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1782480597.589296:0:5830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000062510bb pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:5830:1869066311566592:0@lo:502: 00000100:00100000:2.0:1782480597.589686:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480597.589830:0:5830:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bed73d73 going to sleep for 11 seconds 00000100:00100000:0.0:1782480597.590132:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311566592 00000100:00100000:0.0:1782480597.590141:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311566592 00000100:00100000:0.0:1782480597.590244:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782480597.590254:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000002bd9df63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+9:5830:x1869066311566592:12345-0@lo:502: 00000100:00100000:0.0:1782480597.590720:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000002bd9df63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+9:5830:x1869066311566592:12345-0@lo:502: Request processed in 467us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480597.590729:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782480597.591059:0:5830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000062510bb pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:5830:1869066311566592:0@lo:502: 00000020:01000000:3.0:1782480597.591097:0:5830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782480597.591105:0:5830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480597.591106:0:5830:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782480597.591111:0:5830:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1782480597.591505:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1782480597.591524:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782480597.591583:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 0000000069d51d2a/0x3dc3ebf33c023742 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023749 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480597.591594:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 0000000069d51d2a/0x3dc3ebf33c023742 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023749 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480597.591602:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9b6d47c9a800 from 1 10000000:01000000:1.0:1782480597.591612:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782480597.591647:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 00000000b4c69eb4/0x3dc3ebf33c023796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480597.591655:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 00000000b4c69eb4/0x3dc3ebf33c023796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480597.591662:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 00000000b4c69eb4/0x3dc3ebf33c023796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480597.591680:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a6860e46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311566720:0@lo:101: 00000100:00100000:1.0:1782480597.591722:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480597.591800:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set 00000000aded9e78 going to sleep for 11 seconds 00000100:00100000:3.0:1782480597.591883:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311566720 00000100:00100000:3.0:1782480597.591889:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311566720 00000100:00100000:3.0:1782480597.591950:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782480597.591957:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000ff76c461 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+9:5788:x1869066311566720:12345-0@lo:101: 00010000:00010000:3.0:1782480597.591978:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480597.591990:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dc78e8c9/0x3dc3ebf33c02379d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023796 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480597.592015:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dc78e8c9/0x3dc3ebf33c02379d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023796 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480597.592024:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dc78e8c9/0x3dc3ebf33c02379d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023796 expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480597.592033:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dc78e8c9, rc 0) 00000100:00100000:3.0:1782480597.592073:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000ff76c461 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+10:5788:x1869066311566720:12345-0@lo:101: Request processed in 116us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480597.592080:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782480597.592301:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a6860e46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311566720:0@lo:101: 00010000:00010000:1.0:1782480597.592313:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 00000000b4c69eb4/0x3dc3ebf33c023796 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02379d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480597.592320:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 00000000b4c69eb4/0x3dc3ebf33c023796 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c02379d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480597.592915:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000a6860e46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311566848:0@lo:256: 00000100:00100000:1.0:1782480597.593127:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480597.593152:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set 00000000aded9e78 going to sleep for 11 seconds 00000100:00100000:3.0:1782480597.593409:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311566848 00000100:00100000:3.0:1782480597.593416:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311566848 00000100:00100000:3.0:1782480597.593456:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782480597.593464:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000ff461e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+10:5788:x1869066311566848:12345-0@lo:256: 20000000:01000000:3.0:1782480597.593481:0:5802:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1782480597.593488:0:5802:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1782480597.593565:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000ff461e11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+10:5788:x1869066311566848:12345-0@lo:256: Request processed in 102us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480597.593571:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782480597.593648:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000a6860e46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311566848:0@lo:256: 10000000:01000000:0.0:1782480597.594381:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782480597.594731:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 00000000b4c69eb4/0x3dc3ebf33c023796 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02379d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.594743:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 00000000b4c69eb4/0x3dc3ebf33c023796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02379d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480597.594861:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9b6d47c9a800 from 1 10000000:01000000:1.0:1782480597.594865:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782480597.594898:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 000000000fa7b862/0x3dc3ebf33c0237a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480597.594917:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 000000000fa7b862/0x3dc3ebf33c0237a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480597.594951:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 000000000fa7b862/0x3dc3ebf33c0237a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480597.594986:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000614e0d45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311566976:0@lo:101: 00000100:00100000:1.0:1782480597.595127:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480597.595172:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d8392530 going to sleep for 11 seconds 00000100:00100000:3.0:1782480597.595294:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311566976 00000100:00100000:3.0:1782480597.595301:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311566976 00000100:00100000:3.0:1782480597.595351:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782480597.595359:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000a8a7fac1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+10:5788:x1869066311566976:12345-0@lo:101: 00010000:00010000:3.0:1782480597.595371:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480597.595398:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000079fba214/0x3dc3ebf33c0237ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c0237a4 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480597.595420:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000079fba214/0x3dc3ebf33c0237ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c0237a4 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480597.595430:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000079fba214/0x3dc3ebf33c0237ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c0237a4 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480597.595438:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000079fba214, rc 0) 00000100:00100000:3.0:1782480597.595482:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000a8a7fac1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+11:5788:x1869066311566976:12345-0@lo:101: Request processed in 125us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480597.595489:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782480597.595682:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000614e0d45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311566976:0@lo:101: 00010000:00010000:1.0:1782480597.595697:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 000000000fa7b862/0x3dc3ebf33c0237a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c0237ab expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480597.595704:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 000000000fa7b862/0x3dc3ebf33c0237a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c0237ab expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480597.595788:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000614e0d45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311567104:0@lo:501: 00000100:00100000:1.0:1782480597.595816:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480597.595832:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d8392530 going to sleep for 11 seconds 00000100:00100000:3.0:1782480597.595908:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311567104 00000100:00100000:3.0:1782480597.595914:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311567104 00000100:00100000:3.0:1782480597.595956:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782480597.595962:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000f74d3963 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+11:5788:x1869066311567104:12345-0@lo:501: 00000100:00100000:3.0:1782480597.596873:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000f74d3963 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+11:5788:x1869066311567104:12345-0@lo:501: Request processed in 909us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480597.596883:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782480597.597216:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000614e0d45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311567104:0@lo:501: 00000100:00100000:1.0:1782480597.597259:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000614e0d45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311567232:0@lo:503: 00000100:00100000:1.0:1782480597.597303:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480597.597371:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d8392530 going to sleep for 11 seconds 00000100:00100000:0.0:1782480597.597544:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311567232 00000100:00100000:0.0:1782480597.597551:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311567232 00000100:00100000:0.0:1782480597.597621:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782480597.597629:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000f371de37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+11:5788:x1869066311567232:12345-0@lo:503: 00000040:00080000:0.0:1782480597.597672:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782480597.597728:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000f371de37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+11:5788:x1869066311567232:12345-0@lo:503: Request processed in 100us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480597.597735:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782480597.597839:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000614e0d45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311567232:0@lo:503: 00000040:00080000:2.0:1782480597.599238:0:5835:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1782480597.599608:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1782480597.599628:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782480597.599650:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 000000000fa7b862/0x3dc3ebf33c0237a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c0237ab expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480597.599662:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 000000000fa7b862/0x3dc3ebf33c0237a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c0237ab expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480597.599708:0:5788:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782480597.599711:0:5788:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b6d47c9a800 10000000:01000000:3.0:1782480597.599726:0:5788:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b6d47c9a800 10000000:01000000:3.0:1782480597.599731:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782480597.599737:0:5788:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9b6d47c9a800 from 1 10000000:01000000:3.0:1782480597.599739:0:5788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782480597.599797:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 00000000bfbedf77/0x3dc3ebf33c0237b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480597.599805:0:5788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 00000000bfbedf77/0x3dc3ebf33c0237b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480597.599813:0:5788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 00000000bfbedf77/0x3dc3ebf33c0237b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480597.599833:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000051025995 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311567360:0@lo:101: 00000100:00100000:3.0:1782480597.599886:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480597.600272:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d456aba7 going to sleep for 11 seconds 00000100:00100000:1.0:1782480597.600336:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311567360 00000100:00100000:1.0:1782480597.600343:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311567360 00000100:00100000:1.0:1782480597.600388:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782480597.600396:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000abea19db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+11:5788:x1869066311567360:12345-0@lo:101: 00010000:00010000:1.0:1782480597.600409:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480597.600431:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009fbb461f/0x3dc3ebf33c0237b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c0237b2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480597.600455:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fbb461f/0x3dc3ebf33c0237b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c0237b2 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480597.600466:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009fbb461f/0x3dc3ebf33c0237b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c0237b2 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480597.600475:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009fbb461f, rc 0) 00000100:00100000:1.0:1782480597.600520:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000abea19db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:5788:x1869066311567360:12345-0@lo:101: Request processed in 125us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480597.600527:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782480597.600679:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000051025995 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311567360:0@lo:101: 00010000:00010000:3.0:1782480597.600694:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 00000000bfbedf77/0x3dc3ebf33c0237b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c0237b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480597.600702:0:5788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 00000000bfbedf77/0x3dc3ebf33c0237b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c0237b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480597.600801:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000051025995 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311567488:0@lo:501: 00000100:00100000:3.0:1782480597.600828:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480597.600845:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d456aba7 going to sleep for 11 seconds 00000100:00100000:0.0:1782480597.600890:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311567488 00000100:00100000:0.0:1782480597.600895:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311567488 00000100:00100000:0.0:1782480597.600930:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782480597.601059:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000918121bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+12:5788:x1869066311567488:12345-0@lo:501: 00000100:00100000:0.0:1782480597.601331:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000918121bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+12:5788:x1869066311567488:12345-0@lo:501: Request processed in 277us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480597.601339:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782480597.601469:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000051025995 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311567488:0@lo:501: 00000100:00100000:3.0:1782480597.601498:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000051025995 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311567616:0@lo:503: 00000100:00100000:3.0:1782480597.601543:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480597.601565:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set 00000000d456aba7 going to sleep for 11 seconds 00000100:00100000:1.0:1782480597.601623:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311567616 00000100:00100000:1.0:1782480597.601628:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311567616 00000100:00100000:1.0:1782480597.601648:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782480597.601654:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000fff5af1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:5788:x1869066311567616:12345-0@lo:503: 00000100:00100000:1.0:1782480597.602645:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000fff5af1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:5788:x1869066311567616:12345-0@lo:503: Request processed in 987us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480597.602654:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782480597.602832:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000051025995 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311567616:0@lo:503: 00000100:00100000:0.0:1782480597.603328:0:5836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000dee36316 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:5836:1869066311567744:0@lo:502: 00000100:00100000:0.0:1782480597.603450:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480597.603516:0:5836:0:(client.c:2701:ptlrpc_set_wait()) set 00000000da91abcc going to sleep for 11 seconds 00000100:00100000:3.0:1782480597.603556:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311567744 00000100:00100000:3.0:1782480597.603561:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311567744 00000100:00100000:3.0:1782480597.603643:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782480597.603651:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000019313eb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+12:5836:x1869066311567744:12345-0@lo:502: 00000100:00100000:3.0:1782480597.604056:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000019313eb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+12:5836:x1869066311567744:12345-0@lo:502: Request processed in 407us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480597.604063:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782480597.604300:0:5836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000dee36316 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:5836:1869066311567744:0@lo:502: 00000020:01000004:0.0:1782480597.604370:0:5836:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1782480597.604457:0:5836:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000005343819b) 00000020:00000080:0.0:1782480597.604477:0:5836:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1782480597.604661:0:5836:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000006263253 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1782480597.604665:0:5836:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000006263253 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1782480597.604668:0:5836:0:(obd_mount.c:701:lustre_put_lsi()) put 0000000006263253 4 00010000:00080000:0.0:1782480597.604693:0:5836:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004c4156a0@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:0.0:1782480597.609076:0:5836:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1782480597.609188:0:5836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1782480597.609228:0:5836:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1782480597.609241:0:5836:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3dc3ebf33c0237c7 00000100:00080000:0.0:1782480597.609253:0:5836:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782480597.609258:0:5836:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004c4156a0 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1782480597.609295:0:5836:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dee36316 x1869066311567872/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782480597.609337:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000dee36316 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869066311567872:0@lo:38: 00000100:00100000:0.0:1782480597.609424:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782480597.609491:0:5836:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782480597.610181:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311567872 00000100:00100000:2.0:1782480597.610190:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311567872 00000100:00100000:2.0:1782480597.610232:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782480597.610240:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000ca1d780b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1869066311567872:12345-0@lo:38: 00000100:00100000:2.0:1782480597.610308:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000ca1d780b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1869066311567872:12345-0@lo:38: Request processed in 66us (883us total) trans 0 rc -11/-11 00000100:00100000:2.0:1782480597.610316:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782480597.610356:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782480597.610363:0:3314:0:(import.c:65:import_set_state_nolock()) 000000004c4156a0 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782480597.610367:0:3314:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1782480597.610371:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000dee36316 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869066311567872:0@lo:38: 00000100:00100000:0.0:1782480597.610794:0:5836:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005c1d135d pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:5836:1869066311568000:0@lo:502: 00000100:00100000:0.0:1782480597.610848:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480597.610873:0:5836:0:(client.c:2701:ptlrpc_set_wait()) set 00000000da91abcc going to sleep for 11 seconds 00000100:00100000:0.0:1782480597.611227:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311568000 00000100:00100000:0.0:1782480597.611233:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311568000 00000100:00100000:0.0:1782480597.611274:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782480597.611282:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000053d56e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+12:5836:x1869066311568000:12345-0@lo:502: 00000100:00100000:0.0:1782480597.611545:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000053d56e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+12:5836:x1869066311568000:12345-0@lo:502: Request processed in 263us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480597.611563:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782480597.611678:0:5836:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005c1d135d pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:5836:1869066311568000:0@lo:502: 00000040:00080000:0.0:1782480597.611703:0:5836:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1782480597.615074:0:5788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1782480597.615128:0:5788:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782480597.615187:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 00000000bfbedf77/0x3dc3ebf33c0237b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c0237b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480597.615201:0:5788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 00000000bfbedf77/0x3dc3ebf33c0237b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c0237b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782480597.615253:0:5788:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782480597.615256:0:5788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782480597.615257:0:5788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480597.615259:0:5788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782480597.615260:0:5788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480597.615262:0:5788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480597.615263:0:5788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782480597.615265:0:5788:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782480597.615266:0:5788:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782480597.615268:0:5788:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782480597.615269:0:5788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480597.615270:0:5788:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782480597.615275:0:5788:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1782480597.615278:0:5788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782480597.615284:0:5788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782480597.615285:0:5788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480597.615286:0:5788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782480597.615287:0:5788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480597.615288:0:5788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480597.615289:0:5788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782480597.615290:0:5788:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782480597.615290:0:5788:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782480597.615291:0:5788:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782480597.615292:0:5788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480597.615293:0:5788:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782480597.615329:0:5788:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1782480597.615348:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000051025995 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311568128:0@lo:253: 00000100:00100000:3.0:1782480597.615438:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480597.615538:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set 000000008884550f going to sleep for 11 seconds 00000100:00100000:1.0:1782480597.616123:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311568128 00000100:00100000:1.0:1782480597.616132:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311568128 00000100:00100000:1.0:1782480597.616190:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782480597.616202:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000073f4a397 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+12:5788:x1869066311568128:12345-0@lo:253: 20000000:01000000:1.0:1782480597.616234:0:5802:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1782480597.616246:0:5802:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1782480597.648384:0:5802:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782480597.648407:0:5802:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1782480597.648489:0:5823:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782480597.648494:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782480597.648517:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002115925a/0x3dc3ebf33c0237ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480597.648537:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000dc78e8c9/0x3dc3ebf33c02379d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023796 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480597.648545:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002115925a/0x3dc3ebf33c0237ce lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480597.648597:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000dc78e8c9/0x3dc3ebf33c02379d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c023796 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480597.648610:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000dc78e8c9/0x3dc3ebf33c02379d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c023796 expref: 12 pid: 5801 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480597.648623:0:5823:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e16668c7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1869066311568256:0@lo:104: 00000100:00100000:2.0:1782480597.648688:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480597.648768:0:5823:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bed73d73 going to sleep for 11 seconds 00000100:00100000:0.0:1782480597.648893:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311568256 00000100:00100000:0.0:1782480597.648900:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311568256 00000100:00100000:0.0:1782480597.649076:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782480597.649085:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000292cee9c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+3:5823:x1869066311568256:12345-0@lo:104: 00010000:00010000:0.0:1782480597.649099:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: 00000000b4c69eb4/0x3dc3ebf33c023796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c02379d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.649162:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782480597.649167:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000292cee9c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+3:5823:x1869066311568256:12345-0@lo:104: Request processed in 86us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480597.649174:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782480597.649213:0:5823:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e16668c7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1869066311568256:0@lo:104: 00010000:00010000:0.0:1782480597.649230:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002115925a/0x3dc3ebf33c0237ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.649247:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480597.649251:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: 00000000b4c69eb4/0x3dc3ebf33c023796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c02379d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.649257:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b4c69eb4 already unused, calling callback (00000000cdacaee7) 10000000:00010000:0.0:1782480597.649260:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: 00000000b4c69eb4/0x3dc3ebf33c023796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c02379d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.649267:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: 00000000b4c69eb4/0x3dc3ebf33c023796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c02379d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480597.649283:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: 00000000b4c69eb4/0x3dc3ebf33c023796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c02379d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480597.649288:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782480597.649318:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: 00000000b4c69eb4/0x3dc3ebf33c023796 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c02379d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.649324:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480597.649340:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: 00000000b4c69eb4/0x3dc3ebf33c023796 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c02379d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.649347:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: 00000000b4c69eb4/0x3dc3ebf33c023796 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c02379d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.649362:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480597.649364:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480597.649365:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480597.649416:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005c1d135d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311568384:0@lo:103: 00000100:00100000:0.0:1782480597.649443:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480597.649509:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311568384 00000100:00100000:0.0:1782480597.649514:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311568384 00010000:00010000:0.0:1782480597.649528:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000dc78e8c9/0x3dc3ebf33c02379d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023796 expref: 13 pid: 5801 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480597.649548:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782480597.649554:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000b032b4b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+13:3316:x1869066311568384:12345-0@lo:103: 00010000:00010000:0.0:1782480597.649564:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480597.649568:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000dc78e8c9/0x3dc3ebf33c02379d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023796 expref: 13 pid: 5801 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.649583:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000dc78e8c9/0x3dc3ebf33c02379d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c023796 expref: 13 pid: 5801 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.649595:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dc78e8c9/0x3dc3ebf33c02379d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c023796 expref: 13 pid: 5801 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.649608:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002115925a/0x3dc3ebf33c0237ce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.649615:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002115925a/0x3dc3ebf33c0237ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782480597.649626:0:5792:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001132996s 00010000:00010000:0.0:1782480597.649631:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002115925a/0x3dc3ebf33c0237ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.649637:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002115925a/0x3dc3ebf33c0237ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.649643:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002115925a/0x3dc3ebf33c0237ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.649649:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002115925a/0x3dc3ebf33c0237ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.649653:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002115925a already unused, calling callback (00000000eb73381f) 00010000:00010000:0.0:1782480597.649656:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002115925a/0x3dc3ebf33c0237ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.649662:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002115925a/0x3dc3ebf33c0237ce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.649681:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002115925a/0x3dc3ebf33c0237ce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.649690:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480597.649716:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000b032b4b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:3316:x1869066311568384:12345-0@lo:103: Request processed in 162us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480597.649723:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1782480597.649780:0:5823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002115925a/0x3dc3ebf33c0237ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.649787:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002115925a/0x3dc3ebf33c0237ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480597.649791:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002115925a/0x3dc3ebf33c0237ce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480597.649814:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005c1d135d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311568384:0@lo:103: 00000100:00100000:1.0:1782480597.661790:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000073f4a397 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+11:5788:x1869066311568128:12345-0@lo:253: Request processed in 45583us (46346us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480597.661806:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782480597.662067:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000051025995 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:5788:1869066311568128:0@lo:253: 10000000:01000000:3.0:1782480597.662082:0:5788:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1782480597.662085:0:5788:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782480597.662088:0:5788:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782480597.662089:0:5788:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480597.662091:0:5788:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782480597.662092:0:5788:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480597.662094:0:5788:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480597.662095:0:5788:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782480597.662096:0:5788:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782480597.662098:0:5788:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1782480597.662099:0:5788:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1782480597.662101:0:5788:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480597.662102:0:5788:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782480597.662129:0:5788:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1782480597.672777:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480597.674535:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1782480597.674829:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480597.675744:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1782480597.676445:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480597.676635:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1782480597.678638:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480597.679242:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1782480597.679631:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480597.680248:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1782480597.680649:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480597.682139:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:3.0:1782480597.700277:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:2.0:1782480597.738782:0:5788:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1782480597.777033:0:5788:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1782480597.777399:0:5842:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1782480597.782442:0:5841:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1782480597.782452:0:5841:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1782480597.790215:0:5788:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1782480597.790734:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1782480597.791249:0:5788:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1782480597.791257:0:5788:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1782480597.791551:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782480597.794572:0:5788:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1782480597.795438:0:5788:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1782480597.795480:0:5788:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1782480597.795789:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1782480597.796260:0:5788:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1782480597.801835:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1782480597.806247:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1782480597.806626:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1782480597.806826:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1782480597.807333:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1782480597.807502:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1782480597.807660:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1782480597.807862:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1782480597.808387:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1782480597.808671:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1782480597.808914:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1782480597.809215:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1782480597.809498:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1782480597.809675:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1782480597.810138:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1782480597.810431:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1782480597.811122:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1782480597.811306:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1782480597.811466:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1782480597.811654:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1782480597.811837:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1782480597.812207:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1782480597.812584:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1782480597.812794:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1782480597.813088:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1782480597.813284:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1782480597.813637:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1782480597.813822:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1782480597.814119:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1782480597.814577:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1782480597.814855:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1782480597.815792:0:5788:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1782480597.816076:0:5788:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1782480597.852253:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1782480597.901382:0:5788:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1782480597.901425:0:5788:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4ff4187f988 00100000:10000000:2.0:1782480597.901434:0:5788:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1782480597.902445:0:5788:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782480597.902459:0:5788:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782480597.902472:0:5788:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1782480597.902496:0:5788:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1782480597.969570:0:5842:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1782480597.969646:0:5842:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1782480597.969651:0:5842:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1782480598.711107:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480599.739232:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480600.760616:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480601.782953:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782480602.266903:0:6084:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1782480602.364224:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782480602.364234:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9b6d47c9a800 from 3 10000000:01000000:2.0:1782480602.364239:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782480602.364300:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 00000000e0ffb099/0x3dc3ebf33c0237d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480602.364313:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 00000000e0ffb099/0x3dc3ebf33c0237d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480602.364335:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 00000000e0ffb099/0x3dc3ebf33c0237d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480602.364361:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000051122210 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311568512:0@lo:101: 00000100:00100000:2.0:1782480602.365556:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480602.365613:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set 000000004a2836cc going to sleep for 11 seconds 00000100:00100000:1.0:1782480602.365678:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311568512 00000100:00100000:1.0:1782480602.365688:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311568512 00000100:00100000:1.0:1782480602.365765:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782480602.365774:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000007c2ea0a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+11:5804:x1869066311568512:12345-0@lo:101: 00010000:00010000:1.0:1782480602.365789:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480602.365804:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000092fe3acf/0x3dc3ebf33c0237dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c0237d5 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480602.365827:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000092fe3acf/0x3dc3ebf33c0237dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c0237d5 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480602.365838:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000092fe3acf/0x3dc3ebf33c0237dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c0237d5 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480602.365845:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000092fe3acf, rc 0) 00000100:00100000:1.0:1782480602.365889:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000007c2ea0a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:5804:x1869066311568512:12345-0@lo:101: Request processed in 117us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480602.365896:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782480602.366760:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000051122210 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311568512:0@lo:101: 00010000:00010000:2.0:1782480602.366780:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 00000000e0ffb099/0x3dc3ebf33c0237d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c0237dc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480602.366789:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 00000000e0ffb099/0x3dc3ebf33c0237d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c0237dc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480602.366849:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000051122210 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311568640:0@lo:256: 00000100:00100000:2.0:1782480602.366887:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480602.366922:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set 000000004a2836cc going to sleep for 11 seconds 00000100:00100000:1.0:1782480602.366926:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311568640 00000100:00100000:1.0:1782480602.366931:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311568640 00000100:00100000:1.0:1782480602.366968:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782480602.366975:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000035d31326 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+12:5804:x1869066311568640:12345-0@lo:256: 20000000:01000000:1.0:1782480602.367069:0:5802:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782480602.367089:0:5802:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782480602.367092:0:5802:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1782480602.367172:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000035d31326 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+12:5804:x1869066311568640:12345-0@lo:256: Request processed in 197us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480602.367179:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782480602.367211:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000051122210 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311568640:0@lo:256: 10000000:01000000:1.0:1782480602.367257:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782480602.367263:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 00000000e0ffb099/0x3dc3ebf33c0237d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c0237dc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480602.367270:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 00000000e0ffb099/0x3dc3ebf33c0237d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c0237dc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480602.814876:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782480602.870858:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1782480602.870868:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1782480602.870873:0:8:0:(import.c:65:import_set_state_nolock()) 000000004c4156a0 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782480602.870890:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004c4156a0 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1782480602.870937:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ff7aaaff x1869066311568768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782480602.871037:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000ff7aaaff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869066311568768:0@lo:38: 00000100:00100000:2.0:1782480602.871108:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480602.871305:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311568768 00000100:00100000:1.0:1782480602.871313:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311568768 00000100:00100000:1.0:1782480602.871356:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782480602.871363:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000045e2f9e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1869066311568768:12345-0@lo:38: 00010000:00080000:1.0:1782480602.871400:0:5809:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:1.0:1782480602.871439:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3dc3ebf33c0237e3 00000004:00100000:1.0:1782480602.871479:0:5809:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782480602.871595:0:5809:0:(import.c:65:import_set_state_nolock()) 0000000044a68b59 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782480602.871649:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000045e2f9e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869066311568768:12345-0@lo:38: Request processed in 286us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480602.871657:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782480602.872001:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ff7aaaff x1869066311568768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782480612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782480602.872029:0:3314:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1782480602.872038:0:3314:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1782480602.872042:0:3314:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782480602.872044:0:3314:0:(import.c:65:import_set_state_nolock()) 000000004c4156a0 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782480602.872050:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000ff7aaaff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869066311568768:0@lo:38: 00010000:00010000:1.0:1782480603.832141:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480604.854868:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480605.878973:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782480606.747992:0:6286:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe26993e10 20000000:00000080:0.0:1782480606.748009:0:6286:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b6d464fb400 uarg=0000000000000000 20000000:01000000:0.0:1782480606.748044:0:6286:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1782480606.748051:0:6286:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1782480606.748056:0:6286:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1782480606.748693:0:6286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1782480606.748705:0:6286:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1782480606.752359:0:6286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782480606.752894:0:6286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1782480606.752968:0:6286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1782480606.753020:0:6286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1782480606.753037:0:6286:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1782480606.753056:0:6286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006b7d772a/0x3dc3ebf33c0237ea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480606.753075:0:6286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000079fba214/0x3dc3ebf33c0237ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c0237a4 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480606.753084:0:6286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006b7d772a/0x3dc3ebf33c0237ea lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480606.753122:0:6286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000079fba214/0x3dc3ebf33c0237ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c0237a4 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480606.753137:0:6286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000079fba214/0x3dc3ebf33c0237ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c0237a4 expref: 11 pid: 5799 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480606.753150:0:6286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005c1d135d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6286:1869066311568896:0@lo:104: 00000100:00100000:0.0:1782480606.753210:0:6286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480606.753272:0:6286:0:(client.c:2701:ptlrpc_set_wait()) set 0000000096978e5b going to sleep for 11 seconds 00000100:00100000:3.0:1782480606.753323:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311568896 00000100:00100000:3.0:1782480606.753332:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311568896 00000100:00100000:3.0:1782480606.753381:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782480606.753390:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000494fbdce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+3:6286:x1869066311568896:12345-0@lo:104: 00010000:00010000:3.0:1782480606.753402:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: 000000000fa7b862/0x3dc3ebf33c0237a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c0237ab expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480606.753490:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782480606.753495:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000494fbdce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+3:6286:x1869066311568896:12345-0@lo:104: Request processed in 108us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480606.753502:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1782480606.753555:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480606.753561:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: 000000000fa7b862/0x3dc3ebf33c0237a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c0237ab expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480606.753569:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000fa7b862 already unused, calling callback (00000000cdacaee7) 10000000:00010000:2.0:1782480606.753580:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: 000000000fa7b862/0x3dc3ebf33c0237a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c0237ab expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480606.753588:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: 000000000fa7b862/0x3dc3ebf33c0237a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c0237ab expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480606.753594:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: 000000000fa7b862/0x3dc3ebf33c0237a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c0237ab expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480606.753595:0:6286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005c1d135d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6286:1869066311568896:0@lo:104: 10000000:01000000:2.0:1782480606.753606:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782480606.753619:0:6286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006b7d772a/0x3dc3ebf33c0237ea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480606.753637:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: 000000000fa7b862/0x3dc3ebf33c0237a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c0237ab expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480606.753645:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782480606.753670:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: 000000000fa7b862/0x3dc3ebf33c0237a4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c0237ab expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480606.753676:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: 000000000fa7b862/0x3dc3ebf33c0237a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c0237ab expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480606.753693:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480606.753694:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480606.753707:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480606.753785:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782480606.753796:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000916511c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311569024:0@lo:103: 00000100:00100000:2.0:1782480606.753848:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480606.753975:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311569024 00000100:00100000:0.0:1782480606.753980:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311569024 00010000:00010000:0.0:1782480606.753999:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000079fba214/0x3dc3ebf33c0237ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c0237a4 expref: 12 pid: 5799 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480606.754032:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782480606.754045:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000000a7592d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:3318:x1869066311569024:12345-0@lo:103: 00010000:00010000:0.0:1782480606.754056:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480606.754061:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000079fba214/0x3dc3ebf33c0237ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c0237a4 expref: 12 pid: 5799 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480606.754071:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000079fba214/0x3dc3ebf33c0237ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c0237a4 expref: 12 pid: 5799 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480606.754085:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000079fba214/0x3dc3ebf33c0237ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c0237a4 expref: 12 pid: 5799 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480606.754098:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006b7d772a/0x3dc3ebf33c0237ea lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480606.754106:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006b7d772a/0x3dc3ebf33c0237ea lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480606.754118:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006b7d772a/0x3dc3ebf33c0237ea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480606.754124:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006b7d772a/0x3dc3ebf33c0237ea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480606.754130:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006b7d772a/0x3dc3ebf33c0237ea lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480606.754136:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006b7d772a/0x3dc3ebf33c0237ea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480606.754140:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006b7d772a already unused, calling callback (00000000eb73381f) 00010000:00010000:0.0:1782480606.754144:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006b7d772a/0x3dc3ebf33c0237ea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480606.754156:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006b7d772a/0x3dc3ebf33c0237ea lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480606.754178:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006b7d772a/0x3dc3ebf33c0237ea lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480606.754188:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480606.754217:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000000a7592d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+11:3318:x1869066311569024:12345-0@lo:103: Request processed in 174us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480606.754224:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1782480606.754323:0:6286:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006b7d772a/0x3dc3ebf33c0237ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480606.754332:0:6286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006b7d772a/0x3dc3ebf33c0237ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480606.754339:0:6286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006b7d772a/0x3dc3ebf33c0237ea lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480606.754909:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000916511c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311569024:0@lo:103: 00010000:00010000:1.0:1782480606.903044:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480607.931032:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480607.992010:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782480607.992035:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000052115dbf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311569152:0@lo:400: 00000100:00100000:1.0:1782480607.992102:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480607.992149:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d1c00c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311569280:0@lo:400: 00000100:00100000:1.0:1782480607.992192:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480607.992224:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311569152 00000100:00100000:1.0:1782480607.992231:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311569152 00000100:00100000:1.0:1782480607.992282:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782480607.992291:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000001b59acc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+11:3317:x1869066311569152:12345-0@lo:400: 00000100:00100000:1.0:1782480607.992340:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000001b59acc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+11:3317:x1869066311569152:12345-0@lo:400: Request processed in 51us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480607.992348:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782480607.992392:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311569280 00000100:00100000:1.0:1782480607.992396:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311569280 00000100:00100000:1.0:1782480607.992422:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782480607.992428:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000964cd67f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311569280:12345-0@lo:400: 00000100:00100000:1.0:1782480607.992460:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000964cd67f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311569280:12345-0@lo:400: Request processed in 33us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480607.992465:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782480607.992500:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d1c00c80 x1869066311569280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480607.992514:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d1c00c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311569280:0@lo:400: 00000100:00100000:1.0:1782480607.992537:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000052115dbf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311569152:0@lo:400: 00010000:00010000:1.0:1782480608.954475:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480609.977661:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480611.003066:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480612.029885:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1782480612.308670:0:6600:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1782480612.308674:0:6600:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1782480612.308859:0:6600:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000dfb6a985 00000020:01000004:3.0:1782480612.308875:0:6600:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1782480612.308886:0:6600:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1782480612.308899:0:6600:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000034e421a) 00000020:00000080:3.0:1782480612.308912:0:6600:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1782480612.324332:0:6600:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1782480612.324701:0:6600:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1782480612.392376:0:6600:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1782480612.403578:0:6600:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1782480612.403615:0:6600:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1782480612.403674:0:6600:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1782480612.403985:0:6600:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1782480612.404860:0:6600:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1782480612.404872:0:6600:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782480612.404884:0:6600:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3dc3ebf33c0237f8 00000020:01000004:2.0:1782480612.404892:0:6600:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1782480612.404913:0:6600:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.151@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1782480612.404916:0:6600:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1782480612.404921:0:6600:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1782480612.404926:0:6600:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1782480612.404938:0:6600:0:(genops.c:413:class_newdev()) Allocate new device OSS (0000000039c33a45) 00000020:00000080:2.0:1782480612.404948:0:6600:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1782480612.407034:0:6600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782480612.407220:0:6600:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1782480612.407228:0:6600:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1782480612.413384:0:6600:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1782480612.413399:0:6600:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1782480612.416361:0:6600:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1782480612.416373:0:6600:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1782480612.418983:0:6600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782480612.419300:0:6600:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1782480612.419314:0:6600:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1782480612.421390:0:6600:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1782480612.421402:0:6600:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1782480612.475578:0:6600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782480612.477219:0:6600:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1782480612.477228:0:6600:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1782480612.484382:0:6600:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1782480612.484401:0:6600:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1782480612.492671:0:6600:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1782480612.493114:0:6600:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1782480612.500146:0:6600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782480612.500358:0:6600:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1782480612.500365:0:6600:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1782480612.514137:0:6600:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1782480612.514256:0:6600:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1782480612.579606:0:6600:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782480612.580864:0:6600:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1782480612.580873:0:6600:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1782480612.590328:0:6600:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1782480612.590343:0:6600:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1782480612.591637:0:6600:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1782480612.591673:0:6600:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1782480612.591680:0:6600:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 10000000:01000000:1.0:1782480612.599319:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782480612.599328:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9b6d47c9a800 from 1 10000000:01000000:1.0:1782480612.599332:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782480612.599379:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 000000000fa7b862/0x3dc3ebf33c023806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480612.599391:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 000000000fa7b862/0x3dc3ebf33c023806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480612.599402:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 000000000fa7b862/0x3dc3ebf33c023806 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480612.599440:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000052115dbf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311569408:0@lo:101: 00000100:00100000:1.0:1782480612.599515:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480612.599583:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set 00000000650c2697 going to sleep for 11 seconds 00000100:00100000:2.0:1782480612.599836:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311569408 00000100:00100000:2.0:1782480612.599844:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311569408 00000100:00100000:2.0:1782480612.599889:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782480612.599897:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000729ddf07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+11:5804:x1869066311569408:12345-0@lo:101: 00010000:00010000:2.0:1782480612.599911:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480612.599924:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000086553651/0x3dc3ebf33c02380d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023806 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.599948:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000086553651/0x3dc3ebf33c02380d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023806 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.599969:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000086553651/0x3dc3ebf33c02380d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023806 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.599977:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000086553651, rc 0) 00000100:00100000:2.0:1782480612.600020:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000729ddf07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:5804:x1869066311569408:12345-0@lo:101: Request processed in 124us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480612.600027:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782480612.600075:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000052115dbf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311569408:0@lo:101: 00010000:00010000:2.0:1782480612.600089:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 000000000fa7b862/0x3dc3ebf33c023806 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02380d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.600109:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 000000000fa7b862/0x3dc3ebf33c023806 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c02380d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480612.600160:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000916511c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311569536:0@lo:501: 00000100:00100000:2.0:1782480612.600186:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480612.600219:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e0b1d073 going to sleep for 11 seconds 00000100:00100000:2.0:1782480612.600232:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311569536 00000100:00100000:2.0:1782480612.600235:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311569536 00000100:00100000:2.0:1782480612.600256:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782480612.600261:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000001533a4f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+12:5804:x1869066311569536:12345-0@lo:501: 00000100:00100000:2.0:1782480612.600494:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000001533a4f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+12:5804:x1869066311569536:12345-0@lo:501: Request processed in 232us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480612.600501:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782480612.600533:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000916511c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311569536:0@lo:501: 00000100:00100000:2.0:1782480612.600557:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000916511c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311569664:0@lo:503: 00000100:00100000:2.0:1782480612.600599:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480612.600611:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e0b1d073 going to sleep for 11 seconds 00000100:00100000:2.0:1782480612.600621:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311569664 00000100:00100000:2.0:1782480612.600625:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311569664 00000100:00100000:2.0:1782480612.600645:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782480612.600649:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000f46fb795 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+12:5804:x1869066311569664:12345-0@lo:503: 00000100:00100000:2.0:1782480612.600903:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000f46fb795 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+12:5804:x1869066311569664:12345-0@lo:503: Request processed in 253us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480612.600911:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782480612.600949:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000916511c9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311569664:0@lo:503: 00000100:00100000:2.0:1782480612.601181:0:6615:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000916511c9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:6615:1869066311569792:0@lo:502: 00000100:00100000:2.0:1782480612.601213:0:6615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480612.601233:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311569792 00000100:00100000:2.0:1782480612.601237:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311569792 00000100:00100000:2.0:1782480612.601256:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782480612.601261:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000ec1d6df0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+12:6615:x1869066311569792:12345-0@lo:502: 00000100:00100000:2.0:1782480612.601389:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000ec1d6df0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+12:6615:x1869066311569792:12345-0@lo:502: Request processed in 128us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480612.601396:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782480612.601424:0:6615:0:(client.c:2701:ptlrpc_set_wait()) set 0000000079dccd04 going to sleep for 11 seconds 00000100:00100000:2.0:1782480612.601434:0:6615:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000916511c9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:6615:1869066311569792:0@lo:502: 00000020:01000000:2.0:1782480612.601453:0:6615:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782480612.601463:0:6615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480612.601465:0:6615:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782480612.601482:0:6615:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6d47c9a800 00000020:00000080:2.0:1782480612.601484:0:6615:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782480612.601529:0:6615:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:6615:1869066311569920:0@lo:502: 00000100:00100000:2.0:1782480612.601562:0:6615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480612.601579:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311569920 00000100:00100000:2.0:1782480612.601582:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311569920 00000100:00100000:2.0:1782480612.601601:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782480612.601606:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+12:6615:x1869066311569920:12345-0@lo:502: 00000100:00100000:2.0:1782480612.601704:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+12:6615:x1869066311569920:12345-0@lo:502: Request processed in 97us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480612.601711:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782480612.601737:0:6615:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d43f50cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480612.601768:0:6615:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:6615:1869066311569920:0@lo:502: 00000020:01000000:2.0:1782480612.601784:0:6615:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480612.601787:0:6615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480612.601789:0:6615:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1782480612.601793:0:6615:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1782480612.601852:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1782480612.601866:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782480612.601876:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82164000/0x3dc3ebf33c023806 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02380d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.601885:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d82164000/0x3dc3ebf33c023806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02380d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1782480612.660994:0:6600:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782480612.661040:0:6600:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.151@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1782480612.661045:0:6600:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782480612.661046:0:6600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782480612.661048:0:6600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782480612.661049:0:6600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782480612.661055:0:6600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782480612.661056:0:6600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782480612.661058:0:6600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782480612.661059:0:6600:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782480612.661060:0:6600:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782480612.661062:0:6600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782480612.661063:0:6600:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782480612.661067:0:6600:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1782480612.661070:0:6600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782480612.661071:0:6600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782480612.661071:0:6600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782480612.661072:0:6600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782480612.661073:0:6600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782480612.661074:0:6600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782480612.661075:0:6600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782480612.661076:0:6600:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782480612.661076:0:6600:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782480612.661077:0:6600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782480612.661078:0:6600:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782480612.661264:0:6600:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782480612.661286:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311570048:0@lo:253: 00000100:00100000:2.0:1782480612.661365:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480612.661471:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d43f50840 going to sleep for 11 seconds 00000100:00100000:0.0:1782480612.664044:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311570048 00000100:00100000:0.0:1782480612.664062:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311570048 00000100:00100000:0.0:1782480612.664135:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782480612.664146:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+12:6600:x1869066311570048:12345-0@lo:253: 20000000:01000000:0.0:1782480612.664221:0:5801:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1782480612.664226:0:5801:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1782480612.664232:0:5801:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1782480612.664235:0:5801:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1782480612.665205:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782480612.665411:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1782480612.665425:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1782480612.665476:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1782480612.665484:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1782480612.665515:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1782480612.665564:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1782480612.665966:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1782480612.665985:0:5801:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.151@tcp 20000000:01000000:0.0:1782480612.665987:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:0.0:1782480612.666015:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1782480612.666022:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1782480612.666066:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1782480612.666074:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:0.0:1782480612.666106:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1782480612.666115:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1782480612.666145:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1782480612.666204:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1782480612.670617:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1782480612.670659:0:5801:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.151@tcp 20000000:01000000:0.0:1782480612.670662:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:0.0:1782480612.670700:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1782480612.670709:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1782480612.670742:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1782480612.670874:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:0.0:1782480612.670928:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1782480612.670938:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1782480612.670971:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1782480612.671005:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1782480612.671029:0:5801:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1782480612.671033:0:5801:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1782480612.671042:0:5801:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1782480612.671053:0:5801:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1782480612.671055:0:5801:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1782480612.671073:0:5801:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1782480612.671078:0:5801:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1782480612.671141:0:5801:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1782480612.671144:0:5801:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1782480612.680036:0:6616:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1782480612.680422:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1782480612.680475:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1782480612.680558:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1782480612.680576:0:5801:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1782480612.680579:0:5801:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782480612.681686:0:6617:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1782480612.681912:0:6617:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1782480612.681975:0:6617:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1782480612.682235:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1782480612.682278:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1782480612.682315:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1782480612.682328:0:5801:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1782480612.682331:0:5801:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782480612.701287:0:6618:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1782480612.701385:0:6618:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1782480612.701437:0:6618:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1782480612.704965:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1782480612.705020:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1782480612.710031:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:2.0:1782480612.710086:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1782480612.710131:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023814 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.710153:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d821ed600/0x3dc3ebf33c02372d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023726 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.710162:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d821ec400/0x3dc3ebf33c023749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023742 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.710168:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d82165200/0x3dc3ebf33c0237b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c0237b2 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.710174:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023814 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.710221:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d82165200/0x3dc3ebf33c0237b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c0237b2 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.710239:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d82165200/0x3dc3ebf33c0237b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c0237b2 expref: 12 pid: 5799 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480612.710254:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1869066311570176:0@lo:104: 00000100:00100000:2.0:1782480612.710332:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782480612.710425:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d821ec400/0x3dc3ebf33c023749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c023742 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.710434:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d821ec400/0x3dc3ebf33c023749 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c023742 expref: 12 pid: 5801 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480612.710443:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1869066311570304:0@lo:104: 00000100:00100000:2.0:1782480612.710464:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782480612.710496:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d821ed600/0x3dc3ebf33c02372d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c023726 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.710503:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d821ed600/0x3dc3ebf33c02372d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c023726 expref: 12 pid: 5801 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480612.710511:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1869066311570432:0@lo:104: 00000100:00100000:2.0:1782480612.710531:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480612.710540:0:5801:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d5239d240 going to sleep for 11 seconds 00000100:00100000:0.0:1782480612.710636:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311570176 00000100:00100000:0.0:1782480612.710644:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311570176 00000100:00100000:0.0:1782480612.710689:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311570304 00000100:00100000:0.0:1782480612.710692:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311570304 00000100:00100000:0.0:1782480612.710702:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311570432 00000100:00100000:0.0:1782480612.710703:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311570432 00000100:00100000:0.0:1782480612.710715:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782480612.710724:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+5:5801:x1869066311570176:12345-0@lo:104: 00010000:00010000:0.0:1782480612.710737:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d821eda00/0x3dc3ebf33c0237b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c0237b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.710826:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782480612.710832:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+5:5801:x1869066311570176:12345-0@lo:104: Request processed in 109us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480612.710839:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782480612.710857:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782480612.710863:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+4:5801:x1869066311570304:12345-0@lo:104: 00010000:00010000:0.0:1782480612.710871:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023742 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023749 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.710916:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782480612.710922:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+4:5801:x1869066311570304:12345-0@lo:104: Request processed in 60us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480612.710928:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782480612.710940:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782480612.710946:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+3:5801:x1869066311570432:12345-0@lo:104: 00010000:00010000:0.0:1782480612.710954:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c023726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c02372d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.710980:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1782480612.710984:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+3:5801:x1869066311570432:12345-0@lo:104: Request processed in 39us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480612.710989:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1782480612.711005:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782480612.711011:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d821eda00/0x3dc3ebf33c0237b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c0237b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711019:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821eda00 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:0.0:1782480612.711023:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821eda00/0x3dc3ebf33c0237b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c0237b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711033:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d821eda00/0x3dc3ebf33c0237b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c0237b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480612.711040:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821eda00/0x3dc3ebf33c0237b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c0237b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480612.711046:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782480612.711088:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d821eda00/0x3dc3ebf33c0237b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c0237b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711096:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480612.711119:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d821eda00/0x3dc3ebf33c0237b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c0237b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711125:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d821eda00/0x3dc3ebf33c0237b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c0237b9 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711141:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782480612.711144:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023742 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023749 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711149:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40030a00 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:0.0:1782480612.711152:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023742 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c023749 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711159:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c023749 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480612.711164:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c023749 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480612.711168:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782480612.711179:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023742 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023749 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711184:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480612.711199:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023742 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023749 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711216:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023742 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023749 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711226:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480612.711229:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c023726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c02372d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711234:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40030400 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:0.0:1782480612.711236:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c023726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c02372d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711243:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c023726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c02372d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480612.711248:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c023726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c02372d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480612.711253:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782480612.711266:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c023726 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c02372d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711270:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480612.711275:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c023726 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c02372d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711280:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c023726 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c02372d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711291:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480612.711298:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480612.711299:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480612.711321:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311570560:0@lo:103: 00000100:00100000:0.0:1782480612.711351:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480612.711389:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311570688:0@lo:103: 00000100:00100000:0.0:1782480612.711409:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480612.711424:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480612.711429:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311570816:0@lo:103: 00000100:00100000:0.0:1782480612.711443:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480612.711466:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311570560 00000100:00100000:0.0:1782480612.711470:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311570560 00010000:00010000:0.0:1782480612.711486:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d82165200/0x3dc3ebf33c0237b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c0237b2 expref: 13 pid: 5799 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480612.711498:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311570688 00000100:00100000:0.0:1782480612.711501:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311570688 00010000:00010000:0.0:1782480612.711508:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d821ec400/0x3dc3ebf33c023749 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023742 expref: 14 pid: 5801 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480612.711515:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311570816 00000100:00100000:0.0:1782480612.711517:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311570816 00010000:00010000:0.0:1782480612.711524:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d821ed600/0x3dc3ebf33c02372d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023726 expref: 15 pid: 5801 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480612.711534:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782480612.711539:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+15:3316:x1869066311570560:12345-0@lo:103: 00010000:00010000:0.0:1782480612.711549:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480612.711553:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d82165200/0x3dc3ebf33c0237b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c0237b2 expref: 15 pid: 5799 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711574:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d82165200/0x3dc3ebf33c0237b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c0237b2 expref: 15 pid: 5799 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711587:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480612.711613:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+15:3316:x1869066311570560:12345-0@lo:103: Request processed in 74us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480612.711619:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782480612.711631:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782480612.711637:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+14:3317:x1869066311570688:12345-0@lo:103: 00010000:00010000:0.0:1782480612.711644:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480612.711648:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d821ec400/0x3dc3ebf33c023749 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023742 expref: 14 pid: 5801 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711656:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d821ec400/0x3dc3ebf33c023749 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c023742 expref: 14 pid: 5801 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711665:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480612.711688:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+14:3317:x1869066311570688:12345-0@lo:103: Request processed in 51us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480612.711693:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782480612.711704:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782480612.711709:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+13:3317:x1869066311570816:12345-0@lo:103: 00010000:00010000:0.0:1782480612.711715:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480612.711719:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d821ed600/0x3dc3ebf33c02372d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023726 expref: 13 pid: 5801 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711727:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d821ed600/0x3dc3ebf33c02372d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c023726 expref: 13 pid: 5801 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711771:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023814 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711780:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023814 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711792:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023814 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711799:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023814 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711806:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023814 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711812:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023814 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711829:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d413f5c00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:0.0:1782480612.711832:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023814 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711839:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023814 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711846:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023814 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.711854:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480612.711877:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+13:3317:x1869066311570816:12345-0@lo:103: Request processed in 168us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480612.711890:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782480612.711929:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311570560:0@lo:103: 00000100:00100000:0.0:1782480612.711955:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311570816:0@lo:103: 00000100:00100000:0.0:1782480612.711961:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311570688:0@lo:103: 00010000:00010000:1.0:1782480612.712040:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480612.712112:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d82165200/0x3dc3ebf33c0237b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c0237b2 expref: 12 pid: 5799 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480612.712124:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1869066311570176:0@lo:104: 00010000:00010000:2.0:1782480612.712133:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d821ec400/0x3dc3ebf33c023749 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c023742 expref: 11 pid: 5801 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480612.712141:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1869066311570304:0@lo:104: 00010000:00010000:2.0:1782480612.712148:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d821ed600/0x3dc3ebf33c02372d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c023726 expref: 10 pid: 5801 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480612.712154:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1869066311570432:0@lo:104: 00010000:00010000:2.0:1782480612.712174:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023814 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.712183:0:5801:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023814 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.712189:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023814 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.712205:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023814 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782480612.712218:0:5801:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1782480612.825444:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+9:6600:x1869066311570048:12345-0@lo:253: Request processed in 161287us (164066us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480612.825463:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782480612.825590:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311570048:0@lo:253: 10000000:01000000:2.0:1782480612.825607:0:6600:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1782480612.825610:0:6600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782480612.825612:0:6600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782480612.825613:0:6600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782480612.825614:0:6600:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1782480612.825615:0:6600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782480612.825617:0:6600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782480612.826015:0:6600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782480612.826220:0:6600:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1782480612.826222:0:6600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782480612.826223:0:6600:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1782480612.826251:0:6600:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b6d46055800 from lustre-OST0000 10000000:01000000:2.0:1782480612.826279:0:6600:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1782480612.826282:0:6600:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1782480612.826290:0:6600:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b6d4845cd40 local copy 10000000:01000000:2.0:1782480612.826295:0:6600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782480612.826338:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c02381b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.826350:0:6600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c02381b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.826359:0:6600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c02381b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480612.826380:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311570944:0@lo:101: 00000100:00100000:2.0:1782480612.826441:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480612.826553:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d5239d000 going to sleep for 11 seconds 00000100:00100000:0.0:1782480612.832425:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311570944 00000100:00100000:0.0:1782480612.832442:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311570944 00000100:00100000:1.0:1782480612.833360:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782480612.833377:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+9:6600:x1869066311570944:12345-0@lo:101: 00010000:00010000:1.0:1782480612.833396:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480612.833414:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c023822 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c02381b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480612.833445:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c023822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c02381b expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480612.833456:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c023822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c02381b expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480612.833465:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d82164800, rc 0) 00000100:00100000:1.0:1782480612.833566:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+10:6600:x1869066311570944:12345-0@lo:101: Request processed in 194us (7125us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480612.833573:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782480612.833676:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311570944:0@lo:101: 00010000:00010000:3.0:1782480612.833693:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c02381b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3dc3ebf33c023822 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480612.833713:0:6600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c02381b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3dc3ebf33c023822 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480612.833903:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48576680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311571072:0@lo:501: 00000100:00100000:3.0:1782480612.833944:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480612.836351:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311571072 00000100:00100000:2.0:1782480612.836372:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311571072 00000100:00100000:3.0:1782480612.836422:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d757f6300 going to sleep for 11 seconds 00000100:00100000:2.0:1782480612.836439:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1782480612.836452:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+10:6600:x1869066311571072:12345-0@lo:501: 00000100:00100000:2.0:1782480612.837007:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+10:6600:x1869066311571072:12345-0@lo:501: Request processed in 557us (3061us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782480612.837015:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782480612.839177:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48576680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311571072:0@lo:501: 10000000:01000000:3.0:1782480612.839207:0:6600:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782480612.839264:0:6600:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782480612.839273:0:6600:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c02381b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3dc3ebf33c023822 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480612.839284:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c02381b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3dc3ebf33c023822 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480612.839291:0:6600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c02381b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3dc3ebf33c023822 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480612.839318:0:6600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782480612.839345:0:6600:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b6d46055800 10000000:01000000:3.0:1782480612.839351:0:6600:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782480612.839356:0:6600:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b6d4845cd40 10000000:01000000:3.0:1782480612.839358:0:6600:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1782480612.839362:0:6600:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9b6d4845cd40 from 1 10000000:01000000:3.0:1782480612.839378:0:6600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782480612.839412:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821ede00/0x3dc3ebf33c023829 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480612.839421:0:6600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d821ede00/0x3dc3ebf33c023829 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480612.839431:0:6600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d821ede00/0x3dc3ebf33c023829 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480612.839448:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48576680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311571200:0@lo:101: 00000100:00100000:3.0:1782480612.839499:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480612.839546:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d757f6000 going to sleep for 11 seconds 00010000:00010000:0.0:1782480612.839840:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480612.839847:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c02381b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x3dc3ebf33c023822 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.839854:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d413f5c00 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:0.0:1782480612.839858:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c02381b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x3dc3ebf33c023822 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.839868:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c02381b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x3dc3ebf33c023822 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480612.839874:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c02381b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x3dc3ebf33c023822 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480612.839880:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782480612.839899:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c02381b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3dc3ebf33c023822 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.839905:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480612.839932:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c02381b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3dc3ebf33c023822 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.839938:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c02381b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3dc3ebf33c023822 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.839953:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480612.839955:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480612.839957:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480612.839964:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782480612.839975:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311571328:0@lo:103: 00000100:00100000:0.0:1782480612.840004:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480612.840049:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311571328 00000100:00100000:0.0:1782480612.840054:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311571328 00000100:00100000:0.0:1782480612.840106:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782480612.840115:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+10:3316:x1869066311571328:12345-0@lo:103: 00010000:00010000:0.0:1782480612.840127:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480612.840139:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c023822 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3dc3ebf33c02381b expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.840155:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480612.840185:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+9:3316:x1869066311571328:12345-0@lo:103: Request processed in 71us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480612.840192:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782480612.840223:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311571328:0@lo:103: 00000100:00100000:2.0:1782480612.840395:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311571200 00000100:00100000:2.0:1782480612.840401:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311571200 00000100:00100000:2.0:1782480612.840434:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782480612.840441:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d68bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+9:6600:x1869066311571200:12345-0@lo:101: 00010000:00010000:2.0:1782480612.840453:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480612.840465:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d413f5a00/0x3dc3ebf33c023830 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023829 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.840482:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d413f5a00/0x3dc3ebf33c023830 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023829 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.840493:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d413f5a00/0x3dc3ebf33c023830 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023829 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.840500:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d413f5a00, rc 0) 00000100:00100000:2.0:1782480612.840532:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d68bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+10:6600:x1869066311571200:12345-0@lo:101: Request processed in 92us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480612.840537:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782480612.841287:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48576680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311571200:0@lo:101: 00010000:00010000:3.0:1782480612.841304:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d821ede00/0x3dc3ebf33c023829 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023830 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480612.841312:0:6600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d821ede00/0x3dc3ebf33c023829 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023830 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480612.841329:0:6600:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782480612.841347:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821ede00/0x3dc3ebf33c023829 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023830 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480612.841355:0:6600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d821ede00/0x3dc3ebf33c023829 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023830 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480612.841363:0:6600:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1782480612.841369:0:6600:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782480612.841375:0:6600:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1782480612.841387:0:6600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782480612.841411:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed800/0x3dc3ebf33c023837 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480612.841419:0:6600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed800/0x3dc3ebf33c023837 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480612.841427:0:6600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed800/0x3dc3ebf33c023837 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480612.841442:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48576680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311571456:0@lo:101: 00000100:00100000:3.0:1782480612.841472:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480612.841499:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d757f6000 going to sleep for 11 seconds 00000100:00100000:0.0:1782480612.841584:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311571456 00000100:00100000:0.0:1782480612.841589:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311571456 00000100:00100000:0.0:1782480612.841611:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782480612.841617:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d68bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+10:6600:x1869066311571456:12345-0@lo:101: 00010000:00010000:0.0:1782480612.841808:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480612.841830:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40030400/0x3dc3ebf33c02383e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023837 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.841852:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40030400/0x3dc3ebf33c02383e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023837 expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.841862:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40030400/0x3dc3ebf33c02383e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023837 expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.841869:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40030400, rc 0) 00000100:00100000:0.0:1782480612.841902:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d68bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+11:6600:x1869066311571456:12345-0@lo:101: Request processed in 285us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480612.841908:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48576680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311571456:0@lo:101: 00000100:00100000:0.0:1782480612.841909:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1782480612.841925:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed800/0x3dc3ebf33c023837 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02383e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.841933:0:6600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed800/0x3dc3ebf33c023837 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c02383e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480612.842024:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311571584:0@lo:501: 00000100:00100000:2.0:1782480612.842049:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480612.842078:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51138600 going to sleep for 11 seconds 00000100:00100000:0.0:1782480612.842159:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311571584 00000100:00100000:0.0:1782480612.842163:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311571584 00000100:00100000:0.0:1782480612.842185:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782480612.842191:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d68bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+11:6600:x1869066311571584:12345-0@lo:501: 00000100:00100000:0.0:1782480612.842421:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d68bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+11:6600:x1869066311571584:12345-0@lo:501: Request processed in 228us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480612.842428:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782480612.842459:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311571584:0@lo:501: 00000100:00100000:2.0:1782480612.842485:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311571712:0@lo:503: 00000100:00100000:2.0:1782480612.842520:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480612.842539:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51138600 going to sleep for 11 seconds 00000100:00100000:0.0:1782480612.843195:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311571712 00000100:00100000:0.0:1782480612.843201:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311571712 00000100:00100000:0.0:1782480612.843231:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782480612.843237:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d68bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+11:6600:x1869066311571712:12345-0@lo:503: 00000100:00100000:1.0:1782480612.843631:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d68bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+11:6600:x1869066311571712:12345-0@lo:503: Request processed in 379us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480612.843639:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782480612.843918:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311571712:0@lo:503: 00000040:00080000:2.0:1782480612.844357:0:6600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782480612.844440:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311571840:0@lo:502: 00000100:00100000:2.0:1782480612.844488:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480612.844571:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51138600 going to sleep for 11 seconds 00000100:00100000:1.0:1782480612.844614:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311571840 00000100:00100000:1.0:1782480612.845001:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311571840 00000100:00100000:2.0:1782480612.845260:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782480612.845270:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+11:6600:x1869066311571840:12345-0@lo:502: 00000100:00100000:2.0:1782480612.845520:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+11:6600:x1869066311571840:12345-0@lo:502: Request processed in 251us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480612.845527:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782480612.845962:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311571840:0@lo:502: 00000040:00080000:3.0:1782480612.846454:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782480612.846510:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1782480612.846539:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1782480612.846595:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1782480612.847283:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1782480612.847341:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1782480612.847389:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48576d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311571968:0@lo:502: 00000100:00100000:3.0:1782480612.847458:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480612.847552:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d757f6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782480612.847600:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311571968 00000100:00100000:1.0:1782480612.847612:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311571968 00000100:00100000:1.0:1782480612.847707:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782480612.847716:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+11:6600:x1869066311571968:12345-0@lo:502: 00000100:00100000:1.0:1782480612.848014:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+11:6600:x1869066311571968:12345-0@lo:502: Request processed in 298us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480612.848031:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782480612.850378:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48576d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311571968:0@lo:502: 00000040:00080000:2.0:1782480612.850873:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1782480612.850892:0:6600:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1782480612.852562:0:6619:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782480612.852582:0:6619:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1782480612.852589:0:6619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480612.852591:0:6619:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1782480612.852597:0:6619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782480612.852611:0:6619:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b6d47dd3380) 00000020:00000080:2.0:1782480612.852646:0:6619:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1782480612.852653:0:6619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782480612.852729:0:6619:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6d46055800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1782480612.852737:0:6619:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782480612.852744:0:6619:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3dc3ebf33c02384c 00010000:00010000:2.0:1782480612.859496:0:6619:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1782480612.862141:0:6619:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1782480612.864518:0:6619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1782480612.864927:0:6619:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1782480612.871275:0:6619:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1782480612.871803:0:6619:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1782480612.875248:0:6619:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1782480612.875260:0:6619:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480612.875267:0:6619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480612.875269:0:6619:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1782480612.875272:0:6619:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782480612.875276:0:6619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480612.875278:0:6619:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782480612.875281:0:6619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782480612.875283:0:6619:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1782480612.875357:0:6619:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480612.875361:0:6619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480612.875362:0:6619:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1782480612.875366:0:6619:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1782480612.875801:0:6600:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1782480612.875845:0:6600:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1782480612.875866:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed800/0x3dc3ebf33c023837 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02383e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.875886:0:6600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed800/0x3dc3ebf33c023837 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02383e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480612.875896:0:6600:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9b6d46055800 from 1 10000000:01000000:0.0:1782480612.875899:0:6600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782480612.875943:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023853 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.875952:0:6600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023853 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.875965:0:6600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023853 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480612.876003:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311572096:0@lo:101: 00000100:00100000:0.0:1782480612.876090:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480612.876145:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f38ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1782480612.876473:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311572096 00000100:00100000:1.0:1782480612.876482:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311572096 00000100:00100000:1.0:1782480612.876530:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782480612.876542:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+11:6600:x1869066311572096:12345-0@lo:101: 00010000:00010000:1.0:1782480612.876558:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480612.876571:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d82165e00/0x3dc3ebf33c02385a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023853 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480612.876598:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d82165e00/0x3dc3ebf33c02385a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023853 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480612.876608:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d82165e00/0x3dc3ebf33c02385a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023853 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480612.876617:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d82165e00, rc 0) 00000100:00100000:1.0:1782480612.876688:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+12:6600:x1869066311572096:12345-0@lo:101: Request processed in 149us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480612.876704:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782480612.876991:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311572096:0@lo:101: 00010000:00010000:0.0:1782480612.877009:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023853 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02385a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.877087:0:6600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023853 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c02385a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480612.877195:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311572224:0@lo:501: 00000100:00100000:0.0:1782480612.877235:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480612.877267:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f38ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1782480612.877342:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311572224 00000100:00100000:1.0:1782480612.877348:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311572224 00000100:00100000:1.0:1782480612.877377:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782480612.877385:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:6600:x1869066311572224:12345-0@lo:501: 00000100:00100000:0.0:1782480612.877807:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311572224:0@lo:501: 00000100:00100000:0.0:1782480612.877938:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311572352:0@lo:503: 00000100:00100000:0.0:1782480612.877983:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480612.878089:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f38ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1782480612.878178:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:6600:x1869066311572224:12345-0@lo:501: Request processed in 232us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480612.878194:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782480612.878218:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311572352 00000100:00100000:1.0:1782480612.878222:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311572352 00000100:00100000:1.0:1782480612.878255:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782480612.878261:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:6600:x1869066311572352:12345-0@lo:503: 00000100:00100000:1.0:1782480612.878434:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:6600:x1869066311572352:12345-0@lo:503: Request processed in 172us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480612.878440:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782480612.878957:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311572352:0@lo:503: 00000040:00080000:3.0:1782480612.880376:0:6600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782480612.880461:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48576d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311572480:0@lo:502: 00000100:00100000:3.0:1782480612.880527:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480612.880573:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d468c3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782480612.880964:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311572480 00000100:00100000:1.0:1782480612.880974:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311572480 00000100:00100000:1.0:1782480612.881963:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782480612.881979:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:6600:x1869066311572480:12345-0@lo:502: 00000100:00100000:1.0:1782480612.882253:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:6600:x1869066311572480:12345-0@lo:502: Request processed in 279us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480612.882262:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782480612.882283:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48576d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311572480:0@lo:502: 00000040:00080000:2.0:1782480612.882591:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1782480612.882639:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1782480612.882674:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311572608:0@lo:502: 00000100:00100000:2.0:1782480612.882708:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480612.886579:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311572608 00000100:00100000:1.0:1782480612.886601:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311572608 00000100:00100000:1.0:1782480612.886677:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782480612.886689:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:6600:x1869066311572608:12345-0@lo:502: 00000100:00100000:1.0:1782480612.887124:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:6600:x1869066311572608:12345-0@lo:502: Request processed in 435us (4412us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480612.887134:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782480612.888979:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d511389c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480612.889033:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311572608:0@lo:502: 00000040:00080000:0.0:1782480612.889274:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1782480612.889298:0:6600:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1782480612.891426:0:6623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782480612.891446:0:6623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480612.891449:0:6623:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782480612.891456:0:6623:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6d46055800 00000020:00000080:0.0:1782480612.891464:0:6623:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782480612.891482:0:6623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782480612.891484:0:6623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480612.891485:0:6623:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1782480612.891495:0:6623:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1782480612.895105:0:6600:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1782480612.895161:0:6600:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782480612.895186:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023853 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02385a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480612.895199:0:6600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023853 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02385a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480612.895266:0:6600:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782480612.895269:0:6600:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b6d46055800 10000000:01000000:3.0:1782480612.895272:0:6600:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b6d46055800 10000000:01000000:3.0:1782480612.895276:0:6600:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782480612.895281:0:6600:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9b6d46055800 from 1 10000000:01000000:3.0:1782480612.895284:0:6600:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782480612.895319:0:6600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed400/0x3dc3ebf33c023861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480612.895328:0:6600:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed400/0x3dc3ebf33c023861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480612.895338:0:6600:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed400/0x3dc3ebf33c023861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480612.895363:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48575c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311572736:0@lo:101: 00000100:00100000:3.0:1782480612.895427:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480612.895524:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d468c3840 going to sleep for 11 seconds 00000100:00100000:0.0:1782480612.896891:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311572736 00000100:00100000:0.0:1782480612.896904:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311572736 00000100:00100000:0.0:1782480612.896962:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782480612.896975:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+12:6600:x1869066311572736:12345-0@lo:101: 00010000:00010000:0.0:1782480612.896990:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480612.897005:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023868 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023861 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.897029:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023861 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.897054:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023861 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.897063:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40031200, rc 0) 00000100:00100000:0.0:1782480612.897124:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+13:6600:x1869066311572736:12345-0@lo:101: Request processed in 154us (1696us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480612.897131:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782480612.897521:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48575c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311572736:0@lo:101: 00010000:00010000:1.0:1782480612.897538:0:6600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed400/0x3dc3ebf33c023861 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023868 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480612.897559:0:6600:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed400/0x3dc3ebf33c023861 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023868 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480612.897675:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311572864:0@lo:501: 00000100:00100000:1.0:1782480612.897720:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480612.897787:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae16d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782480612.897868:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311572864 00000100:00100000:2.0:1782480612.897873:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311572864 00000100:00100000:2.0:1782480612.897899:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782480612.897907:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+13:6600:x1869066311572864:12345-0@lo:501: 00000100:00100000:2.0:1782480612.898122:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+13:6600:x1869066311572864:12345-0@lo:501: Request processed in 216us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480612.898128:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782480612.898200:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311572864:0@lo:501: 00000100:00100000:1.0:1782480612.898228:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311572992:0@lo:503: 00000100:00100000:1.0:1782480612.898262:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480612.898288:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae16d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782480612.898393:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311572992 00000100:00100000:3.0:1782480612.898398:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311572992 00000100:00100000:3.0:1782480612.898429:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782480612.898436:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+13:6600:x1869066311572992:12345-0@lo:503: 00000100:00100000:3.0:1782480612.898640:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+13:6600:x1869066311572992:12345-0@lo:503: Request processed in 204us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480612.898653:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782480612.898661:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311572992:0@lo:503: 00000040:00080000:1.0:1782480612.898989:0:6600:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782480612.899053:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311573120:0@lo:502: 00000100:00100000:1.0:1782480612.899089:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480612.899105:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae16d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782480612.899179:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311573120 00000100:00100000:2.0:1782480612.899184:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311573120 00000100:00100000:2.0:1782480612.899216:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782480612.899223:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+13:6600:x1869066311573120:12345-0@lo:502: 00000100:00100000:2.0:1782480612.899373:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+13:6600:x1869066311573120:12345-0@lo:502: Request processed in 151us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480612.899379:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782480612.899470:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311573120:0@lo:502: 00000040:00080000:1.0:1782480612.899689:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1782480612.899732:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1782480612.903667:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1782480612.903917:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1782480612.903977:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1782480612.904052:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1782480612.904150:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1782480612.905196:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1782480612.905297:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1782480612.905329:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1782480612.905355:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1782480612.905391:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1782480612.905421:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1782480612.905461:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1782480612.905502:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1782480612.905546:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1782480612.905574:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1782480612.905615:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1782480612.905647:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1782480612.905677:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1782480612.905720:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1782480612.905791:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1782480612.905855:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1782480612.905910:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1782480612.905941:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1782480612.905966:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1782480612.906007:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1782480612.906040:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1782480612.906099:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311573248:0@lo:502: 00000100:00100000:2.0:1782480612.906184:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480612.906249:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d511389c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480612.906461:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311573248 00000100:00100000:0.0:1782480612.906469:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311573248 00000100:00100000:0.0:1782480612.906521:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782480612.906531:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+13:6600:x1869066311573248:12345-0@lo:502: 00000100:00100000:0.0:1782480612.906741:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+13:6600:x1869066311573248:12345-0@lo:502: Request processed in 211us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480612.906769:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782480612.910625:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311573248:0@lo:502: 00000040:00080000:2.0:1782480612.910828:0:6600:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1782480612.910845:0:6600:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1782480612.916831:0:6624:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1782480612.916871:0:6624:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b6d7f69b380) 00000020:00000080:2.0:1782480612.916895:0:6624:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1782480612.917047:0:6624:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6d46055800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782480612.917051:0:6624:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b6d46055800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1782480612.917053:0:6624:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9b6d46055800 3 00010000:00080000:2.0:1782480612.917079:0:6624:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6d7af53000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.151@tcp at head 00010000:00010000:2.0:1782480612.926525:0:6624:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1782480612.926629:0:6624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1782480612.926671:0:6624:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782480612.926683:0:6624:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3dc3ebf33c023876 00000100:00080000:2.0:1782480612.926698:0:6624:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782480612.926704:0:6624:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b6d7af53000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1782480612.926739:0:6624:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d7ac1d880 x1869066311573376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782480612.927215:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1869066311573376:0@lo:38: 00000100:00100000:0.0:1782480612.927287:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480612.927461:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311573376 00000100:00100000:2.0:1782480612.927468:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311573376 00000100:00100000:2.0:1782480612.927510:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782480612.927517:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1869066311573376:12345-0@lo:38: 00010000:00080000:2.0:1782480612.927540:0:5807:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:2.0:1782480612.927570:0:5807:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3dc3ebf33c02387d 00000004:00100000:2.0:1782480612.927583:0:5807:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782480612.927609:0:5807:0:(import.c:65:import_set_state_nolock()) ffff9b6d7af50000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782480612.927659:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869066311573376:12345-0@lo:38: Request processed in 141us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480612.927667:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1782480612.927704:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b6d7ac1d880 x1869066311573376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782480622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480612.927714:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782480612.927720:0:3314:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1782480612.927726:0:3314:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782480612.927730:0:3314:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782480612.927733:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9b6d7af53000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782480612.927738:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1869066311573376:0@lo:38: 00000100:00080000:3.0:1782480612.927840:0:6624:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:3.0:1782480612.928123:0:6624:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:2.0:1782480612.932600:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782480612.932623:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311573504:0@lo:400: 00000100:00100000:2.0:1782480612.932696:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480612.932800:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311573504 00000100:00100000:2.0:1782480612.932808:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311573504 00000100:00100000:2.0:1782480612.932875:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782480612.932884:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311573504:12345-0@lo:400: 00000100:00100000:2.0:1782480612.932938:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311573504:12345-0@lo:400: Request processed in 54us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480612.932945:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782480612.932988:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b6d7ac1d880 x1869066311573504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480612.933001:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311573504:0@lo:400: 00000020:01000000:2.0:1782480612.933028:0:6600:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1782480612.933063:0:6600:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782480612.933082:0:6600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed400/0x3dc3ebf33c023861 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023868 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.933094:0:6600:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed400/0x3dc3ebf33c023861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023868 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782480612.933158:0:6600:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782480612.933161:0:6600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782480612.933162:0:6600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782480612.933163:0:6600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782480612.933164:0:6600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782480612.933166:0:6600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782480612.933167:0:6600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782480612.933169:0:6600:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782480612.933170:0:6600:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782480612.933172:0:6600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782480612.933174:0:6600:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782480612.933178:0:6600:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1782480612.933181:0:6600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782480612.933182:0:6600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782480612.933210:0:6600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782480612.933211:0:6600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782480612.933212:0:6600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782480612.933213:0:6600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782480612.933214:0:6600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782480612.933215:0:6600:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782480612.933216:0:6600:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782480612.933217:0:6600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782480612.933218:0:6600:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782480612.933236:0:6600:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782480612.933248:0:6600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311573632:0@lo:253: 00000100:00100000:2.0:1782480612.933281:0:6600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480612.933303:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311573632 00000100:00100000:2.0:1782480612.933306:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311573632 00000100:00100000:2.0:1782480612.933331:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782480612.933338:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+13:6600:x1869066311573632:12345-0@lo:253: 20000000:01000000:2.0:1782480612.933358:0:5799:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1782480612.933371:0:5799:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1782480612.935222:0:6600:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51138780 going to sleep for 11 seconds 20000000:01000000:2.0:1782480612.997322:0:5799:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1782480612.997346:0:5799:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1782480612.997454:0:5823:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782480612.997459:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782480612.997488:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d40030e00/0x3dc3ebf33c023884 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.997510:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0237dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c0237d5 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.997520:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d40030e00/0x3dc3ebf33c023884 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.997562:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0237dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c0237d5 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.997592:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0237dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c0237d5 expref: 13 pid: 5799 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480612.997609:0:5823:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1869066311573760:0@lo:104: 00000100:00100000:0.0:1782480612.997683:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480612.997742:0:5823:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f38eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1782480612.998123:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311573760 00000100:00100000:2.0:1782480612.998132:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311573760 00000100:00100000:2.0:1782480612.998182:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782480612.998191:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+3:5823:x1869066311573760:12345-0@lo:104: 00010000:00010000:2.0:1782480612.998204:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d413f4e00/0x3dc3ebf33c0237d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c0237dc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.998256:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782480612.998262:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+3:5823:x1869066311573760:12345-0@lo:104: Request processed in 73us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480612.998269:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1782480612.998300:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480612.998305:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d413f4e00/0x3dc3ebf33c0237d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c0237dc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.998314:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d413f4e00 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:2.0:1782480612.998317:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d413f4e00/0x3dc3ebf33c0237d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c0237dc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.998326:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d413f4e00/0x3dc3ebf33c0237d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c0237dc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480612.998333:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d413f4e00/0x3dc3ebf33c0237d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c0237dc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480612.998338:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1782480612.998363:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d413f4e00/0x3dc3ebf33c0237d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c0237dc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.998370:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782480612.998383:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d413f4e00/0x3dc3ebf33c0237d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c0237dc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.998389:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d413f4e00/0x3dc3ebf33c0237d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c0237dc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.998406:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480612.998408:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480612.998409:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480612.998545:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311573888:0@lo:103: 00000100:00100000:0.0:1782480612.998578:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480612.998655:0:5823:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1869066311573760:0@lo:104: 00010000:00010000:0.0:1782480612.998674:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d40030e00/0x3dc3ebf33c023884 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480612.998738:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311573888 00000100:00100000:2.0:1782480612.998792:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311573888 00010000:00010000:2.0:1782480612.998823:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0237dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c0237d5 expref: 14 pid: 5799 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480612.998961:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782480612.998969:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d465ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+14:3317:x1869066311573888:12345-0@lo:103: 00010000:00010000:2.0:1782480612.998982:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480612.999277:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0237dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c0237d5 expref: 14 pid: 5799 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.999289:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0237dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c0237d5 expref: 14 pid: 5799 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.999304:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0237dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c0237d5 expref: 14 pid: 5799 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.999321:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d40030e00/0x3dc3ebf33c023884 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.999329:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40030e00/0x3dc3ebf33c023884 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782480612.999343:0:5793:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001884676s 00010000:00010000:2.0:1782480612.999348:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d40030e00/0x3dc3ebf33c023884 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.999356:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d40030e00/0x3dc3ebf33c023884 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.999363:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d40030e00/0x3dc3ebf33c023884 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.999369:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d40030e00/0x3dc3ebf33c023884 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.999382:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40030e00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480612.999386:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d40030e00/0x3dc3ebf33c023884 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.999409:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d40030e00/0x3dc3ebf33c023884 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.999422:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d40030e00/0x3dc3ebf33c023884 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480612.999431:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480612.999466:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d465ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+13:3317:x1869066311573888:12345-0@lo:103: Request processed in 497us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480612.999473:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782480612.999650:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311573888:0@lo:103: 00010000:00010000:0.0:1782480612.999671:0:5823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d40030e00/0x3dc3ebf33c023884 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.999679:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d40030e00/0x3dc3ebf33c023884 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480612.999686:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40030e00/0x3dc3ebf33c023884 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480613.022406:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:6600:x1869066311573632:12345-0@lo:253: Request processed in 89058us (89114us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480613.022420:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782480613.022743:0:6600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:6600:1869066311573632:0@lo:253: 10000000:01000000:2.0:1782480613.022802:0:6600:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1782480613.022807:0:6600:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782480613.022817:0:6600:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782480613.022819:0:6600:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782480613.022820:0:6600:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782480613.022821:0:6600:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782480613.022822:0:6600:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782480613.022824:0:6600:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782480613.022825:0:6600:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782480613.022826:0:6600:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782480613.022828:0:6600:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782480613.022829:0:6600:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782480613.022954:0:6600:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1782480613.041550:0:6600:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1782480613.041734:0:6600:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1782480613.042330:0:6600:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1782480613.042555:0:6600:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1782480613.043307:0:6600:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1782480613.046333:0:6600:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1782480613.050370:0:6600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1782480613.052802:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1782480613.362899:0:6600:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1782480613.362906:0:6600:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1782480613.362939:0:6600:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782480613.363005:0:6600:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782480613.363023:0:6600:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1782480613.363051:0:6600:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1782480614.071348:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480615.108698:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480616.122801:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480617.152404:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480618.168221:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480618.231948:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311574144:0@lo:400: 00000100:00100000:0.0:1782480618.231970:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311574016:0@lo:400: 00000100:00100000:3.0:1782480618.232787:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1869066311574272:0@lo:400: 00000100:00100000:0.0:1782480618.234378:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480618.239733:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480618.239832:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311574144 00000100:00100000:2.0:1782480618.239840:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311574144 00000100:00100000:2.0:1782480618.239887:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782480618.239896:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311574144:12345-0@lo:400: 00000100:00100000:2.0:1782480618.239960:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311574144:12345-0@lo:400: Request processed in 64us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480618.239968:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1782480618.241295:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d460b1c00 x1869066311574144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480618.241315:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311574144:0@lo:400: 00000100:00100000:0.0:1782480618.241654:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311574016 00000100:00100000:0.0:1782480618.241661:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311574016 00000100:00100000:0.0:1782480618.241717:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782480618.241726:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+12:3318:x1869066311574016:12345-0@lo:400: 00000100:00100000:0.0:1782480618.241822:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+12:3318:x1869066311574016:12345-0@lo:400: Request processed in 97us (7450us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480618.241829:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782480618.241840:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311574016:0@lo:400: 00000100:00100000:3.0:1782480618.242082:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480618.248916:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311574272 00000100:00100000:0.0:1782480618.248930:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311574272 00000100:00100000:0.0:1782480618.249004:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782480618.249014:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869066311574272:12345-0@lo:400: 00000100:00100000:0.0:1782480618.249108:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869066311574272:12345-0@lo:400: Request processed in 96us (7026us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480618.249115:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1782480618.249258:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782480618.249293:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d460b0e00 x1869066311574272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480618.249307:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1869066311574272:0@lo:400: 10000000:01000000:2.0:1782480618.753386:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782480618.753394:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9b6d47c9a800 from 21 10000000:01000000:2.0:1782480618.753400:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782480618.753445:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c02388b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480618.753457:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c02388b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480618.753467:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c02388b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480618.753491:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311574400:0@lo:101: 00000100:00100000:2.0:1782480618.753565:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480618.753608:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d4659f900 going to sleep for 11 seconds 00000100:00100000:2.0:1782480618.753628:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311574400 00000100:00100000:2.0:1782480618.753634:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311574400 00000100:00100000:2.0:1782480618.753692:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782480618.753712:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:5804:x1869066311574400:12345-0@lo:101: 00010000:00010000:2.0:1782480618.753725:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480618.753763:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023892 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c02388b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480618.753787:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c02388b expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480618.753796:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c02388b expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480618.753805:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d413f5c00, rc 0) 00000100:00100000:2.0:1782480618.753844:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+13:5804:x1869066311574400:12345-0@lo:101: Request processed in 133us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480618.753851:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782480618.754039:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311574400:0@lo:101: 00010000:00010000:3.0:1782480618.754054:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c02388b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023892 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480618.754063:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c02388b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023892 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480618.754115:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48575500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311574528:0@lo:501: 00000100:00100000:3.0:1782480618.754143:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480618.754395:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311574528 00000100:00100000:1.0:1782480618.754401:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311574528 00000100:00100000:1.0:1782480618.754629:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782480618.754638:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+13:5804:x1869066311574528:12345-0@lo:501: 00000100:00100000:3.0:1782480618.755106:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46016a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782480618.755387:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+13:5804:x1869066311574528:12345-0@lo:501: Request processed in 748us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480618.755395:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782480618.755405:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48575500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311574528:0@lo:501: 00000100:00100000:0.0:1782480618.755446:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311574656:0@lo:503: 00000100:00100000:0.0:1782480618.755488:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480618.755510:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d4525ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1782480618.755523:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311574656 00000100:00100000:0.0:1782480618.755527:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311574656 00000100:00100000:0.0:1782480618.755553:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782480618.755559:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+13:5804:x1869066311574656:12345-0@lo:503: 00000100:00100000:0.0:1782480618.755870:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+13:5804:x1869066311574656:12345-0@lo:503: Request processed in 309us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480618.755877:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782480618.761318:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311574656:0@lo:503: 00000100:00100000:1.0:1782480618.762188:0:6872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:6872:1869066311574784:0@lo:502: 00000100:00100000:1.0:1782480618.762263:0:6872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480618.762297:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311574784 00000100:00100000:1.0:1782480618.762304:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311574784 00000100:00100000:1.0:1782480618.762349:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782480618.762358:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+13:6872:x1869066311574784:12345-0@lo:502: 00000100:00100000:1.0:1782480618.762654:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+13:6872:x1869066311574784:12345-0@lo:502: Request processed in 296us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480618.762662:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782480618.762732:0:6872:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae16600 going to sleep for 11 seconds 00000100:00100000:1.0:1782480618.762770:0:6872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:6872:1869066311574784:0@lo:502: 00000100:00100000:1.0:1782480618.762815:0:6872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:6872:1869066311574912:0@lo:502: 00000100:00100000:1.0:1782480618.762848:0:6872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480618.762877:0:6872:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae16600 going to sleep for 11 seconds 00000100:00100000:1.0:1782480618.764112:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311574912 00000100:00100000:1.0:1782480618.764120:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311574912 00000100:00100000:1.0:1782480618.764232:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782480618.764241:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+13:6872:x1869066311574912:12345-0@lo:502: 00000100:00100000:1.0:1782480618.765368:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+13:6872:x1869066311574912:12345-0@lo:502: Request processed in 1124us (2516us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480618.765378:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782480618.765444:0:6872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:6872:1869066311574912:0@lo:502: 00000040:00080000:1.0:1782480618.766087:0:6872:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1782480618.772640:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1782480618.772676:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782480618.772688:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c02388b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023892 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480618.773049:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c02388b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023892 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480618.773059:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782480618.773061:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9b6d47c9a800 from 4 10000000:01000000:3.0:1782480618.773064:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782480618.773105:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec800/0x3dc3ebf33c023899 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480618.773112:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec800/0x3dc3ebf33c023899 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480618.773122:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec800/0x3dc3ebf33c023899 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480618.773145:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311575040:0@lo:101: 00000100:00100000:3.0:1782480618.773571:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480618.773656:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46016900 going to sleep for 11 seconds 00000100:00100000:1.0:1782480618.773713:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311575040 00000100:00100000:1.0:1782480618.773720:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311575040 00000100:00100000:1.0:1782480618.773922:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782480618.773932:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+13:5804:x1869066311575040:12345-0@lo:101: 00010000:00010000:1.0:1782480618.773946:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480618.774216:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d82165c00/0x3dc3ebf33c0238a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023899 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480618.774246:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d82165c00/0x3dc3ebf33c0238a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023899 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480618.774257:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d82165c00/0x3dc3ebf33c0238a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023899 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480618.774265:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d82165c00, rc 0) 00000100:00100000:1.0:1782480618.774358:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+14:5804:x1869066311575040:12345-0@lo:101: Request processed in 427us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480618.774365:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782480618.774432:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311575040:0@lo:101: 00010000:00010000:3.0:1782480618.774572:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec800/0x3dc3ebf33c023899 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c0238a0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480618.774582:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec800/0x3dc3ebf33c023899 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c0238a0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480618.774638:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311575168:0@lo:256: 00000100:00100000:3.0:1782480618.774671:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480618.774765:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46016900 going to sleep for 11 seconds 00000100:00100000:1.0:1782480618.774820:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311575168 00000100:00100000:1.0:1782480618.774826:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311575168 00000100:00100000:1.0:1782480618.774973:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782480618.774983:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+14:5804:x1869066311575168:12345-0@lo:256: 20000000:01000000:1.0:1782480618.774998:0:5799:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782480618.775016:0:5799:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782480618.775019:0:5799:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1782480618.775104:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+14:5804:x1869066311575168:12345-0@lo:256: Request processed in 122us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480618.775118:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782480618.775188:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311575168:0@lo:256: 10000000:01000000:3.0:1782480618.775227:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782480618.775234:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec800/0x3dc3ebf33c023899 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c0238a0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480618.775242:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec800/0x3dc3ebf33c023899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c0238a0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480618.775251:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782480618.775253:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1782480618.775256:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782480618.775276:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c0238a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480618.775283:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c0238a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480618.775291:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c0238a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480618.775304:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311575296:0@lo:101: 00000100:00100000:3.0:1782480618.775326:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480618.775586:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46016900 going to sleep for 11 seconds 00000100:00100000:2.0:1782480618.775949:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311575296 00000100:00100000:2.0:1782480618.775955:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311575296 00000100:00100000:2.0:1782480618.777291:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782480618.777308:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+14:5804:x1869066311575296:12345-0@lo:101: 00010000:00010000:2.0:1782480618.777323:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480618.777338:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d413f4e00/0x3dc3ebf33c0238ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c0238a7 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480618.777362:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d413f4e00/0x3dc3ebf33c0238ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c0238a7 expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480618.777373:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d413f4e00/0x3dc3ebf33c0238ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c0238a7 expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480618.777392:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d413f4e00, rc 0) 00000100:00100000:2.0:1782480618.777460:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+15:5804:x1869066311575296:12345-0@lo:101: Request processed in 147us (2120us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480618.777467:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782480618.777740:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311575296:0@lo:101: 00010000:00010000:2.0:1782480618.777919:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c0238a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c0238ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480618.777929:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c0238a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c0238ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480618.778116:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48575880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311575424:0@lo:501: 00000100:00100000:3.0:1782480618.778151:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480618.778294:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46016900 going to sleep for 11 seconds 00000100:00100000:1.0:1782480618.778334:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311575424 00000100:00100000:1.0:1782480618.778340:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311575424 00000100:00100000:1.0:1782480618.778405:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782480618.778414:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+15:5804:x1869066311575424:12345-0@lo:501: 00000100:00100000:1.0:1782480618.778864:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+15:5804:x1869066311575424:12345-0@lo:501: Request processed in 439us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480618.778872:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782480618.778944:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48575880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311575424:0@lo:501: 00000100:00100000:3.0:1782480618.778985:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48575880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311575552:0@lo:503: 00000100:00100000:3.0:1782480618.779026:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480618.779362:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46016900 going to sleep for 11 seconds 00000100:00100000:2.0:1782480618.779403:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311575552 00000100:00100000:2.0:1782480618.779409:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311575552 00000100:00100000:2.0:1782480618.779434:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782480618.779441:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+15:5804:x1869066311575552:12345-0@lo:503: 00000100:00100000:2.0:1782480618.780250:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+15:5804:x1869066311575552:12345-0@lo:503: Request processed in 806us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480618.780259:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782480618.780337:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48575880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311575552:0@lo:503: 00000100:00100000:1.0:1782480618.781267:0:6873:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:6873:1869066311575680:0@lo:502: 00000100:00100000:1.0:1782480618.781316:0:6873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480618.781381:0:6873:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae16840 going to sleep for 11 seconds 00000100:00100000:3.0:1782480618.781413:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311575680 00000100:00100000:3.0:1782480618.781418:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311575680 00000100:00100000:3.0:1782480618.781599:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782480618.781608:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+15:6873:x1869066311575680:12345-0@lo:502: 00000100:00100000:3.0:1782480618.782008:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+15:6873:x1869066311575680:12345-0@lo:502: Request processed in 399us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480618.782015:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782480618.782441:0:6873:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:6873:1869066311575680:0@lo:502: 00000020:01000000:2.0:1782480618.782482:0:6873:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782480618.782553:0:6873:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1782480618.782560:0:6873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480618.782562:0:6873:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1782480618.782567:0:6873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782480618.782571:0:6873:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:2.0:1782480618.782590:0:6873:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1782480618.782599:0:6873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782480618.782612:0:6873:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b6d7f698000) 00000020:00000080:2.0:1782480618.782631:0:6873:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1782480618.782635:0:6873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782480618.782714:0:6873:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1782480618.782720:0:6873:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1782480618.782725:0:6873:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3dc3ebf33c0238bc 00010000:00080000:2.0:1782480618.782777:0:6873:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6d7f627000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:2.0:1782480618.783319:0:6873:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1782480618.920820:0:6873:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1782480618.920840:0:6873:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1782480618.921352:0:6873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782480618.921498:0:6873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782480618.921546:0:6873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1782480618.921609:0:6873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1782480618.929506:0:6880:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480618.929515:0:6880:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1782480618.937931:0:6873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782480618.937945:0:6873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782480618.938056:0:6873:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1782480618.938078:0:6873:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3dc3ebf33c0238c3 00000100:00080000:1.0:1782480618.938089:0:6873:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782480618.938095:0:6873:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b6d7f627000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1782480618.938131:0:6873:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d48571500 x1869066311575808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782480618.938186:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1869066311575808:0@lo:8: 00000100:00100000:2.0:1782480618.938263:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480618.938382:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311575808 00000100:00100000:0.0:1782480618.938390:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311575808 00000100:00100000:0.0:1782480618.938424:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782480618.938431:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3314:x1869066311575808:12345-0@lo:8: 00010000:00080000:0.0:1782480618.938456:0:6602:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:0.0:1782480618.938485:0:6602:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3dc3ebf33c0238ca 00002000:00100000:0.0:1782480618.938514:0:6602:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b6d7f381000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211365f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1782480618.938518:0:6602:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1782480618.938523:0:6602:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1782480618.938663:0:6602:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1782480618.938839:0:6602:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782480618.938864:0:6602:0:(import.c:65:import_set_state_nolock()) ffff9b6d7f385800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1782480618.939091:0:6873:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1782480618.939155:0:6873:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480618.939160:0:6873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480618.939162:0:6873:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1782480618.939165:0:6873:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782480618.939169:0:6873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480618.939171:0:6873:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782480618.939173:0:6873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782480618.939175:0:6873:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1782480618.939213:0:6873:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48570000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:6873:1869066311575936:0@lo:502: 00000100:00100000:1.0:1782480618.939258:0:6873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480618.939282:0:6873:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae16e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782480618.946433:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1869066311575808:12345-0@lo:8: Request processed in 7991us (8160us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480618.946450:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782480618.946950:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311575936 00000100:00100000:0.0:1782480618.947022:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311575936 00000100:00100000:0.0:1782480618.947078:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782480618.947100:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+15:6873:x1869066311575936:12345-0@lo:502: 00000100:00100000:0.0:1782480618.947364:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+15:6873:x1869066311575936:12345-0@lo:502: Request processed in 264us (8104us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480618.947370:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782480618.947479:0:6873:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48570000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:6873:1869066311575936:0@lo:502: 00000020:01000000:1.0:1782480618.947514:0:6873:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480618.947521:0:6873:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480618.947523:0:6873:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782480618.947527:0:6873:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1782480618.949482:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1782480618.949509:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1782480618.949520:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c0238a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c0238ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480618.949533:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c0238a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c0238ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480618.949544:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1782480618.949546:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9b6d4845cd40 from 1 10000000:01000000:0.0:1782480618.949549:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782480618.949582:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d40031e00/0x3dc3ebf33c0238d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480618.949591:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d40031e00/0x3dc3ebf33c0238d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480618.949600:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d40031e00/0x3dc3ebf33c0238d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480618.949634:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311576064:0@lo:101: 00000100:00100000:0.0:1782480618.949702:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480618.950042:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311576064 00000100:00100000:3.0:1782480618.950050:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311576064 00000100:00100000:3.0:1782480618.950093:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782480618.950102:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+15:5804:x1869066311576064:12345-0@lo:101: 00010000:00010000:3.0:1782480618.950114:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480618.950125:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d821ec000/0x3dc3ebf33c0238d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c0238d1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480618.950147:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d821ec000/0x3dc3ebf33c0238d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c0238d1 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480618.950157:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d821ec000/0x3dc3ebf33c0238d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c0238d1 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480618.950179:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ec000, rc 0) 00000100:00100000:3.0:1782480618.950217:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+16:5804:x1869066311576064:12345-0@lo:101: Request processed in 115us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480618.950223:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782480618.950309:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45cf8180 going to sleep for 11 seconds 00000100:00100000:0.0:1782480618.950331:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311576064:0@lo:101: 00010000:00010000:0.0:1782480618.950345:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d40031e00/0x3dc3ebf33c0238d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c0238d8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480618.950358:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d40031e00/0x3dc3ebf33c0238d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c0238d8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480618.950407:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311576192:0@lo:501: 00000100:00100000:0.0:1782480618.950431:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1782480618.950763:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d48571500 x1869066311575808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782480628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480618.950773:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782480618.950780:0:3314:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1782480618.950788:0:3314:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1782480618.950793:0:3314:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1782480618.950796:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9b6d7f627000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782480618.950814:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1782480618.950820:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1869066311575808:0@lo:8: 00000004:00080000:2.0:1782480618.950848:0:6880:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1782480618.951081:0:6880:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 239792332956ns, next at 0ns, rc = 0 00000100:00100000:0.0:1782480618.956358:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45cf8180 going to sleep for 11 seconds 00000100:00100000:1.0:1782480618.956922:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311576192 00000100:00100000:1.0:1782480618.956932:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311576192 00000100:00100000:3.0:1782480618.959181:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782480618.959199:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+16:5804:x1869066311576192:12345-0@lo:501: 00000100:00100000:3.0:1782480618.959449:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+16:5804:x1869066311576192:12345-0@lo:501: Request processed in 256us (9015us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782480618.959458:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782480618.959529:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311576192:0@lo:501: 10000000:01000000:3.0:1782480618.959569:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782480618.959580:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d40031e00/0x3dc3ebf33c0238d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c0238d8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480618.959591:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d40031e00/0x3dc3ebf33c0238d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c0238d8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782480619.108322:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1782480619.192563:0:6881:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1782480619.192592:0:6881:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6881:1869066311576448:0@lo:7: 00000100:00100000:1.0:1782480619.192661:0:6881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480619.192714:0:6881:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae16840 going to sleep for 11 seconds 00000100:00100000:1.0:1782480619.192771:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311576320:0@lo:13: 00000100:00100000:1.0:1782480619.192794:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480619.192833:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311576448 00000100:00100000:1.0:1782480619.192850:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311576448 00000100:00100000:1.0:1782480619.192900:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782480619.192908:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6881:x1869066311576448:12345-0@lo:7: 00010000:00010000:0.0:1782480619.195291:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782480619.196782:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480619.196807:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311576320 00000100:00100000:0.0:1782480619.196815:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311576320 00000100:00100000:0.0:1782480619.196870:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782480619.196879:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869066311576320:12345-0@lo:13: 00002000:00000024:0.0:1782480619.196908:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1782480619.197002:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869066311576320:12345-0@lo:13: Request processed in 123us (4205us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480619.197009:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782480619.202186:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d48570000 x1869066311576320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480619.202215:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311576320:0@lo:13: 00002000:00080000:1.0:1782480619.204819:0:6605:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1782480619.204828:0:6605:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1782480619.204933:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6881:x1869066311576448:12345-0@lo:7: Request processed in 12020us (12266us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480619.204942:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782480619.205237:0:6881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d48571880 x1869066311576448/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782480635 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480619.205252:0:6881:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6881:1869066311576448:0@lo:7: 00000004:00080000:3.0:1782480619.205266:0:6881:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1782480619.205305:0:6881:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48575880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6881:1869066311576576:0@lo:5: 00000100:00100000:3.0:1782480619.205340:0:6881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480619.205388:0:6881:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d756c8300 going to sleep for 11 seconds 00000100:00100000:1.0:1782480619.206140:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311576576 00000100:00100000:1.0:1782480619.206148:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311576576 00000100:00100000:1.0:1782480619.206196:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782480619.206204:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6881:x1869066311576576:12345-0@lo:5: 00002000:00080000:1.0:1782480619.206230:0:6604:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1782480619.206233:0:6604:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1782480619.206492:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6881:x1869066311576576:12345-0@lo:5: Request processed in 289us (1151us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1782480619.206499:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782480619.206534:0:6881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d48575880 x1869066311576576/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782480635 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480619.206547:0:6881:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48575880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6881:1869066311576576:0@lo:5: 00000004:00080000:1.0:1782480619.206556:0:6881:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1782480619.206582:0:6881:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48570a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6881:1869066311576704:0@lo:700: 00000100:00100000:1.0:1782480619.206609:0:6881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480619.206626:0:6881:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae160c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480619.206643:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311576704 00000100:00100000:1.0:1782480619.206646:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311576704 00000100:00100000:1.0:1782480619.206666:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782480619.206671:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6881:x1869066311576704:12345-0@lo:700: 00000100:00100000:1.0:1782480619.206708:0:6611:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48570380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6611:1869066311576832:0@lo:700: 00000100:00100000:1.0:1782480619.208063:0:6611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480619.208093:0:6611:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae16300 going to sleep for 11 seconds 00000100:00100000:1.0:1782480619.208126:0:5814:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311576832 00000100:00100000:1.0:1782480619.208131:0:5814:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311576832 00000100:00100000:1.0:1782480619.208163:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782480619.208170:0:5814:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6611:x1869066311576832:12345-0@lo:700: 40000000:02000000:0.0:1782480619.301994:0:5814:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1782480619.314507:0:5814:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6611:x1869066311576832:12345-0@lo:700: Request processed in 106330us (106441us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480619.314527:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782480619.316274:0:6611:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d48570380 x1869066311576832/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782480635 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480619.316297:0:6611:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48570380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6611:1869066311576832:0@lo:700: 40000000:02000000:1.0:1782480619.316310:0:6611:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:1.0:1782480619.412442:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1782480619.412461:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:0.0:1782480619.415863:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6881:x1869066311576704:12345-0@lo:700: Request processed in 209182us (209244us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480619.415881:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782480619.416132:0:6881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d48570a80 x1869066311576704/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782480635 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480619.416143:0:6881:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1782480619.416170:0:6881:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48570a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6881:1869066311576704:0@lo:700: 00000004:02000040:3.0:1782480619.518773:0:6881:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1782480619.529968:0:6881:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6881:1869066311576960:0@lo:5: 00000100:00100000:0.0:1782480619.530047:0:6881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480619.530162:0:6881:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45cf8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782480619.532145:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311576960 00000100:00100000:1.0:1782480619.532159:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311576960 00000100:00100000:1.0:1782480619.533595:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782480619.533614:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6881:x1869066311576960:12345-0@lo:5: 00002000:00080000:0.0:1782480619.546623:0:6604:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1782480619.546645:0:6604:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1782480619.558314:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6881:x1869066311576960:12345-0@lo:5: Request processed in 24686us (28245us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1782480619.558327:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1782480619.558768:0:6881:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d460b1880 x1869066311576960/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782480635 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480619.558788:0:6881:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6881:1869066311576960:0@lo:5: 00000004:00080000:0.0:1782480619.558807:0:6881:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1782480620.222287:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782480621.233588:0:6976:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782480621.242368:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480622.264075:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480623.287921:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480624.314468:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480624.379006:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480624.379031:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311577088:0@lo:13: 00000100:00100000:0.0:1782480624.379101:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480624.380043:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311577088 00000100:00100000:1.0:1782480624.380053:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311577088 00000100:00100000:1.0:1782480624.380137:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782480624.380148:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1869066311577088:12345-0@lo:13: 00002000:00000024:1.0:1782480624.380184:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480624.380250:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1869066311577088:12345-0@lo:13: Request processed in 104us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480624.380257:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782480624.380297:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d460b1500 x1869066311577088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480624.380316:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311577088:0@lo:13: 00000100:00080000:0.0:1782480624.382026:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480624.383061:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311577344:0@lo:400: 00000100:00100000:2.0:1782480624.383132:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480624.383162:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782480624.383168:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311577216:0@lo:400: 00000100:00100000:2.0:1782480624.383205:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480624.383245:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311577216 00000100:00100000:2.0:1782480624.383252:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311577216 00000100:00100000:2.0:1782480624.383293:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782480624.383301:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+16:3316:x1869066311577216:12345-0@lo:400: 00000100:00100000:2.0:1782480624.383349:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+16:3316:x1869066311577216:12345-0@lo:400: Request processed in 48us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480624.383355:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1782480624.383404:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311577216:0@lo:400: 00000100:00100000:0.0:1782480624.389285:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311577344 00000100:00100000:0.0:1782480624.389300:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311577344 00000100:00100000:0.0:1782480624.389363:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782480624.389373:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311577344:12345-0@lo:400: 00000100:00100000:0.0:1782480624.389468:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311577344:12345-0@lo:400: Request processed in 97us (6336us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480624.389476:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1782480624.394902:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d7ac1df80 x1869066311577344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480624.394923:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311577344:0@lo:400: 00000100:00100000:0.0:1782480624.395004:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782480624.395018:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1869066311577472:0@lo:400: 00000100:00100000:0.0:1782480624.395081:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480624.402885:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311577472 00000100:00100000:2.0:1782480624.402900:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311577472 00000100:00100000:2.0:1782480624.402960:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782480624.402969:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869066311577472:12345-0@lo:400: 00000100:00100000:2.0:1782480624.403060:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869066311577472:12345-0@lo:400: Request processed in 91us (7978us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480624.403068:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1782480624.403888:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d7ac1c000 x1869066311577472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480624.403904:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1869066311577472:0@lo:400: 00000100:00080000:2.0:1782480624.403932:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1782480624.583305:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1782480625.335700:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480626.360463:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480627.384593:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480628.407878:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480629.442958:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480629.495947:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311577600:0@lo:13: 00000100:00100000:1.0:1782480629.496010:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480629.496087:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311577600 00000100:00100000:1.0:1782480629.496094:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311577600 00000100:00100000:1.0:1782480629.496142:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782480629.496151:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311577600:12345-0@lo:13: 00002000:00000024:1.0:1782480629.496362:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480629.496412:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311577600:12345-0@lo:13: Request processed in 261us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480629.496420:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1782480629.496442:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782480629.496474:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d48570380 x1869066311577600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480629.496497:0:3318:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1782480629.496521:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311577600:0@lo:13: 00000100:00100000:1.0:1782480629.501325:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311577856:0@lo:400: 00000100:00100000:1.0:1782480629.501393:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480629.501440:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782480629.501447:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311577728:0@lo:400: 00000100:00100000:1.0:1782480629.501498:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480629.501541:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311577728 00000100:00100000:1.0:1782480629.501548:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311577728 00000100:00100000:1.0:1782480629.501594:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782480629.501602:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+16:3316:x1869066311577728:12345-0@lo:400: 00000100:00100000:1.0:1782480629.501669:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+16:3316:x1869066311577728:12345-0@lo:400: Request processed in 66us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480629.501684:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782480629.501727:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311577984:0@lo:400: 00000100:00100000:1.0:1782480629.501785:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480629.501815:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311577856 00000100:00100000:1.0:1782480629.501819:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311577856 00000100:00100000:1.0:1782480629.501844:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311577984 00000100:00100000:1.0:1782480629.501846:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311577984 00000100:00100000:1.0:1782480629.501866:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782480629.501871:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311577856:12345-0@lo:400: 00000100:00100000:1.0:1782480629.501900:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311577856:12345-0@lo:400: Request processed in 28us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480629.501905:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782480629.501916:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782480629.501923:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311577984:12345-0@lo:400: 00000100:00100000:1.0:1782480629.501950:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311577984:12345-0@lo:400: Request processed in 28us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480629.501955:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1782480629.501973:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782480629.501999:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d48574a80 x1869066311577984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480629.502013:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311577984:0@lo:400: 00000100:00100000:1.0:1782480629.502947:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311577728:0@lo:400: 00010000:00080000:1.0:1782480629.502961:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d48576300 x1869066311577856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480629.502971:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311577856:0@lo:400: 00010000:00010000:1.0:1782480630.459141:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480631.483835:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480632.505248:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782480633.232579:0:7479:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1782480633.232584:0:7479:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1782480633.232738:0:7479:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b6d7581c000 00000020:01000004:0.0:1782480633.232792:0:7479:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1782480633.232806:0:7479:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1782480633.232821:0:7479:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b6d460bcd40) 00000020:00000080:0.0:1782480633.232837:0:7479:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1782480633.250161:0:7479:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1782480633.250596:0:7479:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1782480633.288274:0:7479:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1782480633.294656:0:7479:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1782480633.295008:0:7479:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1782480633.295059:0:7479:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1782480633.295082:0:7479:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1782480633.295433:0:7479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1782480633.295564:0:7479:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1782480633.295575:0:7479:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3dc3ebf33c0238e6 00000020:01000004:0.0:1782480633.295584:0:7479:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1782480633.295606:0:7479:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.151@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1782480633.295609:0:7479:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1782480633.295623:0:7479:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1782480633.295645:0:7479:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1782480633.295650:0:7479:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1782480633.329365:0:7479:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782480633.329402:0:7479:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.151@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1782480633.329407:0:7479:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782480633.329408:0:7479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782480633.329410:0:7479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782480633.329421:0:7479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782480633.329422:0:7479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782480633.329427:0:7479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782480633.329429:0:7479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782480633.329431:0:7479:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782480633.329432:0:7479:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782480633.329433:0:7479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782480633.329435:0:7479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782480633.329438:0:7479:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1782480633.329440:0:7479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782480633.329441:0:7479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782480633.329443:0:7479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782480633.329451:0:7479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782480633.329452:0:7479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782480633.329454:0:7479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782480633.329455:0:7479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782480633.329456:0:7479:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782480633.329457:0:7479:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782480633.329458:0:7479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782480633.329459:0:7479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782480633.331843:0:7479:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1782480633.331991:0:7479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311578112:0@lo:253: 00000100:00100000:0.0:1782480633.332088:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480633.332239:0:7479:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d47f26900 going to sleep for 11 seconds 00000100:00100000:2.0:1782480633.337426:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311578112 00000100:00100000:2.0:1782480633.337442:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311578112 00000100:00100000:2.0:1782480633.337861:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782480633.337875:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+16:7479:x1869066311578112:12345-0@lo:253: 20000000:01000000:2.0:1782480633.337936:0:5801:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1782480633.337949:0:5801:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1782480633.337954:0:5801:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1782480633.337957:0:5801:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1782480633.339378:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782480633.340111:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1782480633.340128:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1782480633.340172:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1782480633.340179:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1782480633.340209:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1782480633.340274:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1782480633.342049:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1782480633.342074:0:5801:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.151@tcp 20000000:01000000:2.0:1782480633.342076:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:2.0:1782480633.342111:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1782480633.342119:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1782480633.342167:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1782480633.342176:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:2.0:1782480633.342208:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1782480633.342217:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1782480633.342248:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1782480633.342297:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1782480633.359165:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1782480633.359195:0:5801:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.204.151@tcp 20000000:01000000:3.0:1782480633.359198:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:3.0:1782480633.359226:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1782480633.359233:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1782480633.359257:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1782480633.359263:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:3.0:1782480633.359285:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1782480633.359293:0:5801:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1782480633.359329:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1782480633.359360:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1782480633.359374:0:5801:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1782480633.359377:0:5801:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1782480633.359381:0:5801:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1782480633.359391:0:5801:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782480633.359394:0:5801:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1782480633.359440:0:5801:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1782480633.359533:0:5801:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782480633.361389:0:7482:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1782480633.361514:0:7482:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1782480633.361547:0:7482:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1782480633.362334:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1782480633.362382:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1782480633.362484:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1782480633.362497:0:5801:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782480633.362499:0:5801:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782480633.363225:0:7483:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1782480633.363263:0:7483:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1782480633.363305:0:7483:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1782480633.363562:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1782480633.363604:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1782480633.363657:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1782480633.363671:0:5801:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1782480633.364242:0:5801:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1782480633.370344:0:7484:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1782480633.370804:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1782480633.371097:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1782480633.371184:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1782480633.371199:0:5801:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1782480633.371202:0:5801:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782480633.372223:0:7485:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1782480633.372280:0:7485:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1782480633.372330:0:7485:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1782480633.373150:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1782480633.373186:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1782480633.373238:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1782480633.373253:0:5801:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1782480633.373255:0:5801:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1782480633.373263:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782480633.373280:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0238ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.373300:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d40030400/0x3dc3ebf33c02383e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023837 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.373308:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023868 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023861 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.373315:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c02388b expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.373322:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d413f4e00/0x3dc3ebf33c0238ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c0238a7 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.373328:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d821ec000/0x3dc3ebf33c0238d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c0238d1 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.373347:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0238ed lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.373388:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d821ec000/0x3dc3ebf33c0238d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c0238d1 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.373404:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d821ec000/0x3dc3ebf33c0238d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c0238d1 expref: 16 pid: 5801 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480633.373431:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48570a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1869066311578240:0@lo:104: 00000100:00100000:1.0:1782480633.373607:0:5801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782480633.374247:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d413f4e00/0x3dc3ebf33c0238ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c0238a7 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.374257:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d413f4e00/0x3dc3ebf33c0238ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c0238a7 expref: 16 pid: 5801 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480633.374268:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1869066311578368:0@lo:104: 00010000:00010000:1.0:1782480633.374292:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c02388b expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.374300:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023892 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c02388b expref: 16 pid: 5799 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480633.374307:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48570000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1869066311578496:0@lo:104: 00010000:00010000:1.0:1782480633.374328:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c023861 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.374335:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023868 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c023861 expref: 16 pid: 5802 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480633.374352:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1869066311578624:0@lo:104: 00010000:00010000:1.0:1782480633.374378:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d40030400/0x3dc3ebf33c02383e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c023837 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.374385:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d40030400/0x3dc3ebf33c02383e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c023837 expref: 16 pid: 5801 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480633.374393:0:5801:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1869066311578752:0@lo:104: 00000100:00100000:1.0:1782480633.374420:0:5801:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d47f59600 going to sleep for 11 seconds 00000100:00100000:0.0:1782480633.374424:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782480633.374444:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480633.374468:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480633.374476:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480633.374483:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480633.374495:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311578240 00000100:00100000:0.0:1782480633.374502:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311578240 00000100:00100000:0.0:1782480633.374546:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311578368 00000100:00100000:0.0:1782480633.374549:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311578368 00000100:00100000:0.0:1782480633.374561:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311578496 00000100:00100000:0.0:1782480633.374569:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311578496 00000100:00100000:0.0:1782480633.374597:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311578624 00000100:00100000:0.0:1782480633.374600:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311578624 00000100:00100000:0.0:1782480633.374609:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311578752 00000100:00100000:0.0:1782480633.374611:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311578752 00000100:00100000:0.0:1782480633.374623:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782480633.374641:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d5e999050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+7:5801:x1869066311578240:12345-0@lo:104: 00010000:00010000:0.0:1782480633.374653:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d40031e00/0x3dc3ebf33c0238d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c0238d8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.374733:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782480633.374740:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d5e999050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+7:5801:x1869066311578240:12345-0@lo:104: Request processed in 101us (1134us total) trans 0 rc 0/0 00010000:00010000:3.0:1782480633.374766:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1782480633.374769:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1782480633.374773:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d40031e00/0x3dc3ebf33c0238d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c0238d8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480633.374780:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40031e00 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:3.0:1782480633.374783:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d40031e00/0x3dc3ebf33c0238d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c0238d8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480633.374792:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d40031e00/0x3dc3ebf33c0238d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c0238d8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480633.374799:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d40031e00/0x3dc3ebf33c0238d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c0238d8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480633.374805:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1782480633.374807:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782480633.374813:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+6:5801:x1869066311578368:12345-0@lo:104: 00000100:00100000:1.0:1782480633.374968:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48570a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1869066311578240:0@lo:104: 00010000:00010000:0.0:1782480633.376830:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c0238a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c0238ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.376957:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782480633.376967:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+6:5801:x1869066311578368:12345-0@lo:104: Request processed in 2152us (2520us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480633.376977:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782480633.377007:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782480633.377016:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1869066311578368:0@lo:104: 00000100:00100000:0.0:1782480633.377016:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+5:5801:x1869066311578496:12345-0@lo:104: 00010000:00010000:0.0:1782480633.377026:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c02388b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023892 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480633.377092:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48570000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1869066311578496:0@lo:104: 00010000:00010000:3.0:1782480633.378038:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d40031e00/0x3dc3ebf33c0238d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c0238d8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480633.378049:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782480633.378095:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311578880:0@lo:103: 00000100:00100000:1.0:1782480633.378142:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782480633.378213:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1782480633.378241:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311578880 00000100:00100000:2.0:1782480633.378248:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311578880 00010000:00010000:2.0:1782480633.378276:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d821ec000/0x3dc3ebf33c0238d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c0238d1 expref: 17 pid: 5801 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480633.378764:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d40031e00/0x3dc3ebf33c0238d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c0238d8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480633.378773:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d40031e00/0x3dc3ebf33c0238d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c0238d8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480633.378863:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782480633.378884:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48572d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+17:3318:x1869066311578880:12345-0@lo:103: 00010000:00010000:2.0:1782480633.378897:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480633.378903:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d821ec000/0x3dc3ebf33c0238d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c0238d1 expref: 17 pid: 5801 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.378915:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d821ec000/0x3dc3ebf33c0238d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c0238d1 expref: 17 pid: 5801 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.378932:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d821ec000/0x3dc3ebf33c0238d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c0238d1 expref: 17 pid: 5801 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.378944:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480633.381610:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782480633.384445:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+5:5801:x1869066311578496:12345-0@lo:104: Request processed in 7423us (9967us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480633.384459:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782480633.388578:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48572d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+16:3318:x1869066311578880:12345-0@lo:103: Request processed in 9687us (10426us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480633.388578:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311578880:0@lo:103: 00000100:00100000:2.0:1782480633.388597:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1782480633.388633:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480633.388640:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c02388b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023892 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.388651:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d413f5200 already unused, calling callback (ffffffffc1b1fc20) 00000100:00100000:1.0:1782480633.388651:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 10000000:00010000:2.0:1782480633.388658:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c02388b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c023892 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480633.388665:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+4:5801:x1869066311578624:12345-0@lo:104: 00010000:00010000:2.0:1782480633.388673:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c02388b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c023892 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.388681:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed400/0x3dc3ebf33c023861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023868 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480633.388683:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c02388b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c023892 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480633.388700:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782480633.388760:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c02388b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023892 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.388769:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782480633.388771:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782480633.388778:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+4:5801:x1869066311578624:12345-0@lo:104: Request processed in 118us (14300us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480633.388785:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1782480633.388791:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c02388b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023892 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.388799:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c02388b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023892 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480633.388811:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1782480633.388814:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480633.388819:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed400/0x3dc3ebf33c023861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023868 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480633.388820:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+3:5801:x1869066311578752:12345-0@lo:104: 00010000:00010000:2.0:1782480633.388832:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ed400 already unused, calling callback (ffffffffc1b1fc20) 00010000:00010000:1.0:1782480633.388835:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed800/0x3dc3ebf33c023837 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c02383e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480633.388837:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed400/0x3dc3ebf33c023861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c023868 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.388854:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed400/0x3dc3ebf33c023861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c023868 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480633.388860:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed400/0x3dc3ebf33c023861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c023868 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480633.388865:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782480633.388872:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782480633.388878:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+3:5801:x1869066311578752:12345-0@lo:104: Request processed in 60us (14393us total) trans 0 rc 0/0 00010000:00010000:2.0:1782480633.388880:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed400/0x3dc3ebf33c023861 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023868 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480633.388887:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1782480633.388893:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782480633.388900:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed400/0x3dc3ebf33c023861 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023868 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.388916:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed400/0x3dc3ebf33c023861 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023868 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480633.388920:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1869066311578624:0@lo:104: 00010000:00010000:2.0:1782480633.388932:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1782480633.388934:0:5801:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1869066311578752:0@lo:104: 00010000:00010000:2.0:1782480633.388938:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed800/0x3dc3ebf33c023837 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c02383e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.388945:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ed800 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:2.0:1782480633.388948:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed800/0x3dc3ebf33c023837 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c02383e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.388955:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed800/0x3dc3ebf33c023837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c02383e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.388958:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0238ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480633.388964:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed800/0x3dc3ebf33c023837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c02383e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480633.388973:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782480633.388988:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed800/0x3dc3ebf33c023837 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c02383e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.388994:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782480633.389020:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed800/0x3dc3ebf33c023837 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c02383e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.389027:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d821ed800/0x3dc3ebf33c023837 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c02383e expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.389037:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480633.389044:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480633.389046:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480633.389065:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311579008:0@lo:103: 00000100:00100000:2.0:1782480633.389100:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480633.389139:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782480633.389145:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311579136:0@lo:103: 00000100:00100000:2.0:1782480633.389165:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480633.389192:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311579008 00000100:00100000:2.0:1782480633.389197:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311579008 00010000:00010000:2.0:1782480633.389217:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023892 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c02388b expref: 16 pid: 5799 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480633.389235:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311579136 00000100:00100000:2.0:1782480633.389238:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311579136 00010000:00010000:2.0:1782480633.389248:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023868 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023861 expref: 17 pid: 5802 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480633.389260:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782480633.389265:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+17:3315:x1869066311579008:12345-0@lo:103: 00010000:00010000:2.0:1782480633.389275:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480633.389280:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023892 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c02388b expref: 17 pid: 5799 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.389288:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c02388b expref: 17 pid: 5799 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.389302:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023892 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c02388b expref: 17 pid: 5799 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.389314:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480633.389345:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+16:3315:x1869066311579008:12345-0@lo:103: Request processed in 79us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480633.389351:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782480633.389364:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782480633.389370:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+15:3315:x1869066311579136:12345-0@lo:103: 00010000:00010000:2.0:1782480633.389377:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480633.389381:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023868 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023861 expref: 15 pid: 5802 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.389390:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c023861 expref: 15 pid: 5802 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.389400:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023868 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c023861 expref: 15 pid: 5802 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.389418:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480633.389440:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+14:3315:x1869066311579136:12345-0@lo:103: Request processed in 70us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480633.389445:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782480633.389468:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311579136:0@lo:103: 00000100:00100000:2.0:1782480633.389476:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311579008:0@lo:103: 00000100:00100000:2.0:1782480633.389489:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782480633.389495:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311579264:0@lo:103: 00000100:00100000:2.0:1782480633.389516:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480633.389556:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311579264 00000100:00100000:2.0:1782480633.389560:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311579264 00010000:00010000:2.0:1782480633.389572:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d40030400/0x3dc3ebf33c02383e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023837 expref: 14 pid: 5801 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480633.389607:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782480633.389613:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+14:3318:x1869066311579264:12345-0@lo:103: 00010000:00010000:2.0:1782480633.389621:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480633.389626:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d40030400/0x3dc3ebf33c02383e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023837 expref: 14 pid: 5801 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.389633:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d40030400/0x3dc3ebf33c02383e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c023837 expref: 14 pid: 5801 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.389643:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40030400/0x3dc3ebf33c02383e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c023837 expref: 14 pid: 5801 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.389654:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480633.389688:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+13:3318:x1869066311579264:12345-0@lo:103: Request processed in 75us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480633.389694:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1782480633.389734:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480633.389740:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c0238a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c0238ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.389802:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ecc00 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:2.0:1782480633.389805:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c0238a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c0238ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.389813:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c0238a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c0238ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480633.389819:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c0238a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c0238ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480633.389831:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782480633.389849:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c0238a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c0238ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.389855:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782480633.389861:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c0238a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c0238ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.389866:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c0238a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c0238ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.389880:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480633.389882:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480633.389884:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480633.389892:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480633.389894:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480633.395322:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311579392:0@lo:103: 00000100:00100000:3.0:1782480633.395421:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480633.395485:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311579264:0@lo:103: 00000100:00100000:0.0:1782480633.395589:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311579392 00000100:00100000:0.0:1782480633.395596:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311579392 00010000:00010000:0.0:1782480633.395629:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d413f4e00/0x3dc3ebf33c0238ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c0238a7 expref: 13 pid: 5801 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480633.395670:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782480633.395679:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48574380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+13:3318:x1869066311579392:12345-0@lo:103: 00010000:00010000:0.0:1782480633.395692:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480633.395698:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d413f4e00/0x3dc3ebf33c0238ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c0238a7 expref: 13 pid: 5801 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.395709:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d413f4e00/0x3dc3ebf33c0238ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c0238a7 expref: 13 pid: 5801 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.395725:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d413f4e00/0x3dc3ebf33c0238ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c0238a7 expref: 13 pid: 5801 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.395742:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0238ed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.395776:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0238ed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.395794:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0238ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.395801:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0238ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.395818:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0238ed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.395824:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0238ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.395830:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d82165a00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:0.0:1782480633.395834:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0238ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.395842:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0238ed lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.395856:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0238ed lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.395866:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480633.395905:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48574380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:3318:x1869066311579392:12345-0@lo:103: Request processed in 226us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480633.395912:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782480633.395945:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311579392:0@lo:103: 00010000:00010000:1.0:1782480633.396109:0:5801:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0238ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.396118:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0238ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.396126:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0238ed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782480633.396140:0:5801:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1782480633.479937:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+11:7479:x1869066311578112:12345-0@lo:253: Request processed in 142057us (147839us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480633.479952:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782480633.481923:0:7479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311578112:0@lo:253: 10000000:01000000:3.0:1782480633.481943:0:7479:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1782480633.481946:0:7479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782480633.481948:0:7479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782480633.481949:0:7479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480633.481950:0:7479:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1782480633.481951:0:7479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480633.481953:0:7479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480633.481954:0:7479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782480633.481956:0:7479:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1782480633.481958:0:7479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480633.481959:0:7479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782480633.481982:0:7479:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b6d7581c000 from lustre-OST0001 10000000:01000000:3.0:1782480633.482009:0:7479:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1782480633.482012:0:7479:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782480633.482019:0:7479:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b6d4845cd40 local copy 10000000:01000000:3.0:1782480633.482023:0:7479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782480633.482064:0:7479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821edc00/0x3dc3ebf33c0238f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480633.482075:0:7479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.151@tcp lock: ffff9b6d821edc00/0x3dc3ebf33c0238f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480633.482084:0:7479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d821edc00/0x3dc3ebf33c0238f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480633.482233:0:7479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311579520:0@lo:101: 00000100:00100000:3.0:1782480633.482293:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480633.482362:0:7479:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d756c8300 going to sleep for 11 seconds 00000100:00100000:1.0:1782480633.482579:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311579520 00000100:00100000:1.0:1782480633.482586:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311579520 00000100:00100000:1.0:1782480633.482643:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782480633.482652:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+11:7479:x1869066311579520:12345-0@lo:101: 00010000:00010000:1.0:1782480633.482666:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480633.482829:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0238fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c0238f4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.482852:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0238fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c0238f4 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.482862:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0238fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c0238f4 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.482871:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d82165a00, rc 0) 00000100:00100000:1.0:1782480633.482906:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+12:7479:x1869066311579520:12345-0@lo:101: Request processed in 254us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480633.482912:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782480633.482990:0:7479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311579520:0@lo:101: 00010000:00010000:3.0:1782480633.483003:0:7479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d821edc00/0x3dc3ebf33c0238f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3dc3ebf33c0238fb expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480633.483012:0:7479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d821edc00/0x3dc3ebf33c0238f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3dc3ebf33c0238fb expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480633.483369:0:7479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311579648:0@lo:501: 00000100:00100000:3.0:1782480633.483398:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480633.483434:0:7479:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d756c8300 going to sleep for 11 seconds 00000100:00100000:1.0:1782480633.483521:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311579648 00000100:00100000:1.0:1782480633.483527:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311579648 00000100:00100000:1.0:1782480633.483596:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782480633.483603:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+12:7479:x1869066311579648:12345-0@lo:501: 00000100:00100000:1.0:1782480633.484092:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+12:7479:x1869066311579648:12345-0@lo:501: Request processed in 488us (691us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782480633.484117:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782480633.484185:0:7479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311579648:0@lo:501: 10000000:01000000:3.0:1782480633.484212:0:7479:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782480633.484241:0:7479:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782480633.484249:0:7479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821edc00/0x3dc3ebf33c0238f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3dc3ebf33c0238fb expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480633.484258:0:7479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821edc00/0x3dc3ebf33c0238f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3dc3ebf33c0238fb expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480633.484264:0:7479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9b6d821edc00/0x3dc3ebf33c0238f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3dc3ebf33c0238fb expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480633.484285:0:7479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782480633.484370:0:7479:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b6d7581c000 10000000:01000000:3.0:1782480633.484376:0:7479:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782480633.484381:0:7479:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782480633.484384:0:7479:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782480633.484389:0:7479:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1782480633.484398:0:7479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782480633.484431:0:7479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c023902 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480633.484438:0:7479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c023902 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480633.484446:0:7479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c023902 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480633.484460:0:7479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311579776:0@lo:101: 00000100:00100000:3.0:1782480633.484487:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782480633.485543:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480633.485553:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d821edc00/0x3dc3ebf33c0238f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3dc3ebf33c0238fb expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.485563:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821edc00 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:0.0:1782480633.485566:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821edc00/0x3dc3ebf33c0238f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3dc3ebf33c0238fb expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.485591:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d821edc00/0x3dc3ebf33c0238f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x3dc3ebf33c0238fb expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480633.485598:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821edc00/0x3dc3ebf33c0238f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x3dc3ebf33c0238fb expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480633.485605:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782480633.485629:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d821edc00/0x3dc3ebf33c0238f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3dc3ebf33c0238fb expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.485636:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480633.485654:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d821edc00/0x3dc3ebf33c0238f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3dc3ebf33c0238fb expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.485661:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d821edc00/0x3dc3ebf33c0238f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3dc3ebf33c0238fb expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.485685:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480633.485687:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480633.485689:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480633.486502:0:7479:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d756c86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480633.486658:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311579904:0@lo:103: 00000100:00100000:3.0:1782480633.486722:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480633.486780:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311579904 00000100:00100000:3.0:1782480633.486786:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311579904 00000100:00100000:3.0:1782480633.486835:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782480633.486843:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:3315:x1869066311579904:12345-0@lo:103: 00010000:00010000:3.0:1782480633.486855:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480633.486872:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c0238fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3dc3ebf33c0238f4 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480633.486888:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480633.486921:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+11:3315:x1869066311579904:12345-0@lo:103: Request processed in 78us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480633.486929:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782480633.486970:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311579904:0@lo:103: 00000100:00100000:2.0:1782480633.487089:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311579776 00000100:00100000:2.0:1782480633.487225:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311579776 00000100:00100000:2.0:1782480633.487258:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782480633.487265:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+11:7479:x1869066311579776:12345-0@lo:101: 00010000:00010000:2.0:1782480633.487279:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480633.487294:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d6873c600/0x3dc3ebf33c023909 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023902 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.487315:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d6873c600/0x3dc3ebf33c023909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023902 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.487324:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d6873c600/0x3dc3ebf33c023909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023902 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.487348:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6873c600, rc 0) 00000100:00100000:2.0:1782480633.487387:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:7479:x1869066311579776:12345-0@lo:101: Request processed in 124us (2900us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480633.487392:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782480633.487895:0:7479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311579776:0@lo:101: 00010000:00010000:3.0:1782480633.487918:0:7479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c023902 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023909 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480633.487926:0:7479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c023902 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023909 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480633.488034:0:7479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311580032:0@lo:501: 00000100:00100000:3.0:1782480633.488067:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480633.488214:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311580032 00000100:00100000:2.0:1782480633.488219:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311580032 00000100:00100000:2.0:1782480633.488252:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782480633.488259:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:7479:x1869066311580032:12345-0@lo:501: 00000100:00100000:2.0:1782480633.488456:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:7479:x1869066311580032:12345-0@lo:501: Request processed in 198us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480633.488463:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782480633.488506:0:7479:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d756c86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480633.488518:0:7479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311580032:0@lo:501: 00000100:00100000:3.0:1782480633.488542:0:7479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311580160:0@lo:503: 00000100:00100000:3.0:1782480633.488574:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480633.488593:0:7479:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d756c86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480633.488641:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311580160 00000100:00100000:1.0:1782480633.488646:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311580160 00000100:00100000:1.0:1782480633.488664:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782480633.488733:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+12:7479:x1869066311580160:12345-0@lo:503: 00000100:00100000:1.0:1782480633.489259:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+12:7479:x1869066311580160:12345-0@lo:503: Request processed in 586us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480633.489271:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782480633.489351:0:7479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311580160:0@lo:503: 00000040:00080000:3.0:1782480633.492945:0:7479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782480633.493968:0:7479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311580288:0@lo:502: 00000100:00100000:3.0:1782480633.494060:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480633.494111:0:7479:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d756c86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480633.494219:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311580288 00000100:00100000:1.0:1782480633.494226:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311580288 00000100:00100000:1.0:1782480633.494273:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782480633.494282:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d59946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+12:7479:x1869066311580288:12345-0@lo:502: 00000100:00100000:3.0:1782480633.496995:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d59946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+12:7479:x1869066311580288:12345-0@lo:502: Request processed in 2705us (2926us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480633.497010:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782480633.497134:0:7479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311580288:0@lo:502: 00000040:00080000:0.0:1782480633.497426:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1782480633.497486:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1782480633.497519:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1782480633.497619:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1782480633.497660:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1782480633.497810:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1782480633.497848:0:7479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311580416:0@lo:502: 00000100:00100000:0.0:1782480633.497897:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480633.497945:0:7479:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45d20f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782480633.498361:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311580416 00000100:00100000:1.0:1782480633.498370:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311580416 00000100:00100000:1.0:1782480633.498454:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782480633.498464:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d5a19c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+12:7479:x1869066311580416:12345-0@lo:502: 00000100:00100000:1.0:1782480633.498665:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d5a19c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+12:7479:x1869066311580416:12345-0@lo:502: Request processed in 202us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480633.499660:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782480633.499937:0:7479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311580416:0@lo:502: 00000040:00080000:0.0:1782480633.500112:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1782480633.500125:0:7479:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1782480633.502175:0:7488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782480633.502189:0:7488:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1782480633.502196:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480633.502199:0:7488:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1782480633.502206:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782480633.502237:0:7488:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b6d7562cd40) 00000020:00000080:1.0:1782480633.502261:0:7488:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1782480633.502268:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1782480633.502376:0:7488:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6d7581c000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1782480633.502384:0:7488:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1782480633.502390:0:7488:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3dc3ebf33c023917 00010000:00010000:3.0:1782480633.515589:0:7488:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1782480633.517123:0:7488:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1782480633.521057:0:7488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1782480633.521353:0:7488:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1782480633.528186:0:7488:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00010000:00010000:2.0:1782480633.529962:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1782480633.530372:0:7488:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1782480633.537417:0:7488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1782480633.537430:0:7488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480633.537436:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480633.537438:0:7488:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1782480633.537441:0:7488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782480633.537445:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480633.537447:0:7488:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782480633.537450:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782480633.537452:0:7488:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1782480633.537505:0:7488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480633.537509:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480633.537510:0:7488:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1782480633.537513:0:7488:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1782480633.553795:0:7479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1782480633.553840:0:7479:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1782480633.553863:0:7479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c023902 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023909 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.553877:0:7479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c023902 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023909 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480633.553887:0:7479:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9b6d7581c000 from 1 10000000:01000000:0.0:1782480633.553889:0:7479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782480633.553935:0:7479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c02391e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.553943:0:7479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c02391e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.553954:0:7479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c02391e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480633.553979:0:7479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311580544:0@lo:101: 00000100:00100000:0.0:1782480633.554047:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480633.554086:0:7479:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d5236a180 going to sleep for 11 seconds 00000100:00100000:3.0:1782480633.554219:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311580544 00000100:00100000:3.0:1782480633.554227:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311580544 00000100:00100000:3.0:1782480633.554280:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782480633.554289:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+12:7479:x1869066311580544:12345-0@lo:101: 00010000:00010000:3.0:1782480633.554302:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480633.554315:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d821ed800/0x3dc3ebf33c023925 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c02391e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480633.554339:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d821ed800/0x3dc3ebf33c023925 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c02391e expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480633.554349:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d821ed800/0x3dc3ebf33c023925 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c02391e expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480633.554357:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ed800, rc 0) 00000100:00100000:3.0:1782480633.554397:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+13:7479:x1869066311580544:12345-0@lo:101: Request processed in 109us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480633.554404:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782480633.555973:0:7479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311580544:0@lo:101: 00010000:00010000:0.0:1782480633.555997:0:7479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c02391e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023925 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.556025:0:7479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c02391e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023925 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480633.556135:0:7479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311580672:0@lo:501: 00000100:00100000:0.0:1782480633.556177:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480633.556217:0:7479:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d5236a180 going to sleep for 11 seconds 00000100:00100000:2.0:1782480633.556272:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311580672 00000100:00100000:2.0:1782480633.556278:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311580672 00000100:00100000:2.0:1782480633.556316:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782480633.556324:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+13:7479:x1869066311580672:12345-0@lo:501: 00000100:00100000:2.0:1782480633.556580:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+13:7479:x1869066311580672:12345-0@lo:501: Request processed in 256us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480633.556588:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782480633.557077:0:7479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311580672:0@lo:501: 00000100:00100000:0.0:1782480633.557108:0:7479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311580800:0@lo:503: 00000100:00100000:0.0:1782480633.557148:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480633.557178:0:7479:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d5236a180 going to sleep for 11 seconds 00000100:00100000:1.0:1782480633.557226:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311580800 00000100:00100000:1.0:1782480633.557231:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311580800 00000100:00100000:1.0:1782480633.557263:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1782480633.557271:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+13:7479:x1869066311580800:12345-0@lo:503: 00000100:00100000:1.0:1782480633.557607:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+13:7479:x1869066311580800:12345-0@lo:503: Request processed in 335us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480633.557633:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782480633.558090:0:7479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311580800:0@lo:503: 00000040:00080000:0.0:1782480633.558395:0:7479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782480633.558487:0:7479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311580928:0@lo:502: 00000100:00100000:0.0:1782480633.558527:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480633.558603:0:7479:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49339600 going to sleep for 11 seconds 00000100:00100000:3.0:1782480633.562869:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311580928 00000100:00100000:3.0:1782480633.562884:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311580928 00000100:00100000:3.0:1782480633.562986:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782480633.562996:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+13:7479:x1869066311580928:12345-0@lo:502: 00000100:00100000:3.0:1782480633.563285:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+13:7479:x1869066311580928:12345-0@lo:502: Request processed in 290us (4757us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480633.563293:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1782480633.565638:0:7479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311580928:0@lo:502: 00000040:00080000:0.0:1782480633.566019:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1782480633.566086:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1782480633.566124:0:7479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311581056:0@lo:502: 00000100:00100000:0.0:1782480633.566186:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480633.566223:0:7479:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49339600 going to sleep for 11 seconds 00000100:00100000:3.0:1782480633.566436:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311581056 00000100:00100000:3.0:1782480633.566444:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311581056 00000100:00100000:3.0:1782480633.566501:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782480633.566510:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+13:7479:x1869066311581056:12345-0@lo:502: 00000100:00100000:3.0:1782480633.566789:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+13:7479:x1869066311581056:12345-0@lo:502: Request processed in 279us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480633.566798:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1782480633.567258:0:7479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311581056:0@lo:502: 00000040:00080000:0.0:1782480633.567386:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1782480633.567398:0:7479:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1782480633.579085:0:7492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782480633.579101:0:7492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480633.579104:0:7492:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782480633.579112:0:7492:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6d7581c000 00000020:00000080:0.0:1782480633.579114:0:7492:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782480633.579139:0:7492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782480633.579142:0:7492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480633.579144:0:7492:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1782480633.579147:0:7492:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1782480633.579327:0:7479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1782480633.579352:0:7479:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782480633.579372:0:7479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c02391e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023925 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.579385:0:7479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c02391e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023925 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480633.579445:0:7479:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782480633.579448:0:7479:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b6d7581c000 10000000:01000000:1.0:1782480633.579451:0:7479:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b6d7581c000 10000000:01000000:1.0:1782480633.579456:0:7479:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782480633.579462:0:7479:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9b6d7581c000 from 1 10000000:01000000:1.0:1782480633.579465:0:7479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782480633.579512:0:7479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c02392c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.579522:0:7479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c02392c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.579606:0:7479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c02392c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480633.579907:0:7479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311581184:0@lo:101: 00000100:00100000:1.0:1782480633.579975:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480633.580882:0:7479:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d47f593c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480633.589288:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311581184 00000100:00100000:3.0:1782480633.589304:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311581184 00000100:00100000:3.0:1782480633.589383:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782480633.589393:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+13:7479:x1869066311581184:12345-0@lo:101: 00010000:00010000:3.0:1782480633.589421:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480633.589442:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d821ed400/0x3dc3ebf33c023933 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c02392c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480633.589865:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d821ed400/0x3dc3ebf33c023933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c02392c expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480633.589881:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d821ed400/0x3dc3ebf33c023933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c02392c expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480633.589890:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ed400, rc 0) 00000100:00100000:3.0:1782480633.589978:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+14:7479:x1869066311581184:12345-0@lo:101: Request processed in 583us (9999us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480633.589985:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782480633.590130:0:7479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311581184:0@lo:101: 00010000:00010000:1.0:1782480633.590157:0:7479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c02392c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023933 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.590192:0:7479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c02392c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023933 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480633.590402:0:7479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311581312:0@lo:501: 00000100:00100000:1.0:1782480633.590458:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480633.590517:0:7479:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d47f593c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480633.590641:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311581312 00000100:00100000:2.0:1782480633.590649:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311581312 00000100:00100000:2.0:1782480633.590699:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782480633.590710:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+14:7479:x1869066311581312:12345-0@lo:501: 00000100:00100000:2.0:1782480633.591059:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+14:7479:x1869066311581312:12345-0@lo:501: Request processed in 348us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480633.591068:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782480633.591962:0:7479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311581312:0@lo:501: 00000100:00100000:1.0:1782480633.592005:0:7479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311581440:0@lo:503: 00000100:00100000:1.0:1782480633.592063:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480633.592137:0:7479:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d47f593c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480633.595381:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311581440 00000100:00100000:3.0:1782480633.595395:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311581440 00000100:00100000:3.0:1782480633.595499:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782480633.595509:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+14:7479:x1869066311581440:12345-0@lo:503: 00000100:00100000:3.0:1782480633.596156:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+14:7479:x1869066311581440:12345-0@lo:503: Request processed in 647us (4092us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480633.596163:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1782480633.596267:0:7479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311581440:0@lo:503: 00000040:00080000:1.0:1782480633.596684:0:7479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782480633.596790:0:7479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311581568:0@lo:502: 00000100:00100000:1.0:1782480633.596839:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480633.600374:0:7479:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d43f50480 going to sleep for 11 seconds 00000100:00100000:2.0:1782480633.603970:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311581568 00000100:00100000:2.0:1782480633.603987:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311581568 00000100:00100000:1.0:1782480633.605339:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1782480633.605351:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+14:7479:x1869066311581568:12345-0@lo:502: 00000100:00100000:1.0:1782480633.605718:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+14:7479:x1869066311581568:12345-0@lo:502: Request processed in 369us (8878us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480633.605727:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782480633.605986:0:7479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311581568:0@lo:502: 00000040:00080000:3.0:1782480633.606300:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1782480633.606358:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1782480633.606394:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1782480633.606458:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1782480633.606498:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1782480633.606562:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1782480633.606601:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1782480633.606637:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1782480633.606698:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1782480633.606735:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1782480633.606814:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1782480633.606865:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1782480633.606904:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1782480633.606939:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1782480633.606991:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1782480633.607027:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1782480633.607063:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1782480633.607113:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1782480633.607149:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1782480633.607182:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1782480633.607246:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1782480633.607283:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1782480633.607318:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1782480633.607369:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1782480633.607404:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1782480633.607454:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1782480633.607502:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1782480633.607541:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1782480633.607577:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1782480633.607628:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1782480633.607664:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1782480633.607709:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1782480633.607743:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1782480633.607826:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1782480633.607864:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1782480633.607926:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1782480633.607977:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1782480633.608022:0:7479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48577800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311581696:0@lo:502: 00000100:00100000:3.0:1782480633.608088:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480633.608127:0:7479:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d756c8780 going to sleep for 11 seconds 00000100:00100000:2.0:1782480633.608590:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311581696 00000100:00100000:2.0:1782480633.608599:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311581696 00000100:00100000:2.0:1782480633.608655:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1782480633.608664:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+14:7479:x1869066311581696:12345-0@lo:502: 00000100:00100000:2.0:1782480633.608944:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+14:7479:x1869066311581696:12345-0@lo:502: Request processed in 280us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480633.608951:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782480633.609837:0:7479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48577800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311581696:0@lo:502: 00000040:00080000:3.0:1782480633.609960:0:7479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1782480633.609974:0:7479:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1782480633.612456:0:7493:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1782480633.612482:0:7493:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b6d6d8919c0) 00000020:00000080:3.0:1782480633.612506:0:7493:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1782480633.613084:0:7493:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6d7581c000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782480633.613089:0:7493:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b6d7581c000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782480633.613091:0:7493:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9b6d7581c000 3 00010000:00080000:3.0:1782480633.613122:0:7493:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6d6f082800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.151@tcp at head 00010000:00010000:3.0:1782480633.619428:0:7493:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1782480633.621086:0:7493:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1782480633.621129:0:7493:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782480633.621141:0:7493:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3dc3ebf33c023941 00000100:00080000:3.0:1782480633.621152:0:7493:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782480633.621160:0:7493:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b6d6f082800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1782480633.621195:0:7493:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d48577800 x1869066311581824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782480633.621215:0:7493:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782480633.621516:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1869066311581824:0@lo:38: 00000100:00100000:2.0:1782480633.621599:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480633.622071:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311581824 00000100:00100000:3.0:1782480633.622086:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311581824 00000100:00100000:1.0:1782480633.622320:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782480633.622332:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311581952:0@lo:400: 00000100:00100000:1.0:1782480633.622365:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480633.625608:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311582080:0@lo:400: 00000100:00100000:1.0:1782480633.627909:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311582208:0@lo:400: 00000100:00100000:1.0:1782480633.627980:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480633.628029:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480633.628153:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311581952 00000100:00100000:3.0:1782480633.628162:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311581952 00000100:00100000:3.0:1782480633.628205:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782480633.628214:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311581952:12345-0@lo:400: 00000100:00100000:3.0:1782480633.628288:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311581952:12345-0@lo:400: Request processed in 74us (5921us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480633.628295:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782480633.628312:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782480633.628318:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1869066311581824:12345-0@lo:38: 00010000:00080000:3.0:1782480633.628339:0:5809:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:3.0:1782480633.628387:0:5809:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3dc3ebf33c023948 00000004:00100000:3.0:1782480633.628417:0:5809:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782480633.628452:0:5809:0:(import.c:65:import_set_state_nolock()) ffff9b6d7f118000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782480633.628497:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869066311581824:12345-0@lo:38: Request processed in 177us (6897us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480633.628504:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782480633.628638:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48577800 x1869066311581824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782480643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480633.628651:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782480633.628658:0:3314:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1782480633.628666:0:3314:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1782480633.628679:0:3314:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782480633.628681:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9b6d6f082800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782480633.628687:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1869066311581824:0@lo:38: 00000040:00080000:3.0:1782480633.628859:0:7493:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1782480633.629002:0:7494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48577800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7494:1869066311582336:0@lo:901: 00000100:00100000:3.0:1782480633.629033:0:7494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480633.629061:0:5818:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311582336 00000100:00100000:3.0:1782480633.629065:0:5818:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311582336 00000100:00100000:3.0:1782480633.629096:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782480633.629103:0:5818:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7494:x1869066311582336:12345-0@lo:901: 00000100:00100000:3.0:1782480633.629438:0:5818:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7494:x1869066311582336:12345-0@lo:901: Request processed in 334us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480633.629445:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782480633.629467:0:7494:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d756c8d80 going to sleep for 11 seconds 00010000:00080000:3.0:1782480633.629482:0:7494:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48577800 x1869066311582336/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1782480649 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480633.629492:0:7494:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48577800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7494:1869066311582336:0@lo:901: 00000100:00100000:1.0:1782480633.634287:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311582208 00000100:00100000:1.0:1782480633.634298:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311582208 00000100:00100000:1.0:1782480633.634346:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782480633.634357:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311582208:12345-0@lo:400: 00000100:00100000:1.0:1782480633.634458:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311582208:12345-0@lo:400: Request processed in 104us (6478us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480633.634465:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782480633.634510:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48571500 x1869066311581952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480633.634526:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311581952:0@lo:400: 00000100:00080000:1.0:1782480633.634552:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782480633.634556:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480633.634566:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311582080 00000100:00100000:1.0:1782480633.634570:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311582080 00000100:00100000:1.0:1782480633.634600:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782480633.634606:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311582080:12345-0@lo:400: 00000100:00100000:1.0:1782480633.634641:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311582080:12345-0@lo:400: Request processed in 36us (6612us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480633.634647:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1782480633.634873:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48571880 x1869066311582208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480633.634885:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311582208:0@lo:400: 00000100:00080000:1.0:1782480633.634903:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782480633.634920:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48570000 x1869066311582080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480633.634945:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311582080:0@lo:400: 00000020:01000000:1.0:1782480633.634963:0:7479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1782480633.634990:0:7479:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782480633.635003:0:7479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c02392c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023933 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.635014:0:7479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c02392c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023933 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782480633.635057:0:7479:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782480633.635058:0:7479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782480633.635060:0:7479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782480633.635061:0:7479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782480633.635062:0:7479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782480633.635063:0:7479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782480633.635065:0:7479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782480633.635067:0:7479:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782480633.635068:0:7479:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782480633.635070:0:7479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782480633.635071:0:7479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782480633.635074:0:7479:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1782480633.635077:0:7479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782480633.635078:0:7479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782480633.635079:0:7479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782480633.635080:0:7479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782480633.635081:0:7479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782480633.635082:0:7479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782480633.635083:0:7479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782480633.635084:0:7479:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782480633.635085:0:7479:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782480633.635086:0:7479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782480633.635087:0:7479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782480633.635104:0:7479:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1782480633.635118:0:7479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48570000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311582464:0@lo:253: 00000100:00100000:1.0:1782480633.635166:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480633.635192:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311582464 00000100:00100000:1.0:1782480633.635196:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311582464 00000100:00100000:1.0:1782480633.635221:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782480633.635228:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+14:7479:x1869066311582464:12345-0@lo:253: 20000000:01000000:1.0:1782480633.635257:0:5802:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1782480633.635271:0:5802:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1782480633.637842:0:7479:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d47f59d80 going to sleep for 11 seconds 20000000:01000000:2.0:1782480633.678214:0:5802:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1782480633.678261:0:5802:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1782480633.678336:0:5823:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782480633.678342:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782480633.678369:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c02394f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.678390:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d82165c00/0x3dc3ebf33c0238a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023899 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.678400:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c02394f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.678454:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d82165c00/0x3dc3ebf33c0238a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c023899 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.678470:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d82165c00/0x3dc3ebf33c0238a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c023899 expref: 14 pid: 5802 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480633.678486:0:5823:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1869066311582592:0@lo:104: 00000100:00100000:0.0:1782480633.679080:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480633.679156:0:5823:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49339180 going to sleep for 11 seconds 00000100:00100000:2.0:1782480633.679285:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311582592 00000100:00100000:2.0:1782480633.679293:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311582592 00000100:00100000:2.0:1782480633.679343:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782480633.679352:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+3:5823:x1869066311582592:12345-0@lo:104: 00010000:00010000:2.0:1782480633.679377:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec800/0x3dc3ebf33c023899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c0238a0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.679507:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782480633.679514:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+3:5823:x1869066311582592:12345-0@lo:104: Request processed in 164us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480633.679521:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1782480633.679803:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480633.679810:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec800/0x3dc3ebf33c023899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c0238a0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.679818:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ec800 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:1.0:1782480633.679822:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec800/0x3dc3ebf33c023899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c0238a0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.679830:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec800/0x3dc3ebf33c023899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c0238a0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782480633.679837:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec800/0x3dc3ebf33c023899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c0238a0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480633.679842:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782480633.679872:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec800/0x3dc3ebf33c023899 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c0238a0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.679877:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782480633.679895:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec800/0x3dc3ebf33c023899 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c0238a0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.679901:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec800/0x3dc3ebf33c023899 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c0238a0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480633.679923:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480633.679924:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480633.679926:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480633.679939:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311582720:0@lo:103: 00000100:00100000:1.0:1782480633.679972:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480633.680076:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311582720 00000100:00100000:2.0:1782480633.680083:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311582720 00010000:00010000:2.0:1782480633.680104:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d82165c00/0x3dc3ebf33c0238a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023899 expref: 15 pid: 5802 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480633.680124:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782480633.680131:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d465fd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+15:3315:x1869066311582720:12345-0@lo:103: 00010000:00010000:2.0:1782480633.680142:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480633.680146:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d82165c00/0x3dc3ebf33c0238a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023899 expref: 15 pid: 5802 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.680156:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d82165c00/0x3dc3ebf33c0238a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c023899 expref: 15 pid: 5802 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.680175:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c02394f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.680185:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c02394f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782480633.680199:0:5794:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001884676s 00010000:00010000:2.0:1782480633.680204:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c02394f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.680220:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c02394f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.680227:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c02394f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.680233:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c02394f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.680238:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40031200 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480633.680242:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c02394f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.680248:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c02394f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.680257:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c02394f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480633.680266:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480633.680297:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d465fd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+15:3315:x1869066311582720:12345-0@lo:103: Request processed in 166us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480633.680304:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782480633.680358:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311582720:0@lo:103: 00010000:00010000:0.0:1782480633.683001:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d82165c00/0x3dc3ebf33c0238a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c023899 expref: 14 pid: 5802 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480633.683034:0:5823:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5823:1869066311582592:0@lo:104: 00010000:00010000:0.0:1782480633.683057:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c02394f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.683068:0:5823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c02394f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.683074:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c02394f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480633.683081:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c02394f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480633.694424:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+13:7479:x1869066311582464:12345-0@lo:253: Request processed in 59177us (59237us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480633.694440:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1782480633.694523:0:7479:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48570000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7fffafe6-aedd-4500-93d4-974eea0c11af:7479:1869066311582464:0@lo:253: 10000000:01000000:1.0:1782480633.694653:0:7479:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1782480633.694657:0:7479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782480633.694659:0:7479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782480633.694660:0:7479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782480633.694661:0:7479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782480633.694663:0:7479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782480633.694664:0:7479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782480633.694665:0:7479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782480633.694715:0:7479:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782480633.694717:0:7479:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782480633.694718:0:7479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782480633.694720:0:7479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782480633.694737:0:7479:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1782480633.702838:0:7479:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1782480633.703062:0:7479:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1782480633.703380:0:7479:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1782480633.703876:0:7479:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1782480633.704069:0:7479:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1782480633.704500:0:7479:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1782480633.706037:0:7479:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1782480634.010856:0:7479:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1782480634.010864:0:7479:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1782480634.010900:0:7479:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782480634.010954:0:7479:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782480634.010968:0:7479:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1782480634.010995:0:7479:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1782480634.552367:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480634.616658:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311582848:0@lo:13: 00000100:00100000:1.0:1782480634.616728:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480634.618692:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311582848 00000100:00100000:0.0:1782480634.618704:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311582848 00000100:00100000:0.0:1782480634.618840:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782480634.618851:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311582848:12345-0@lo:13: 00002000:00000024:0.0:1782480634.618893:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480634.618966:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311582848:12345-0@lo:13: Request processed in 117us (2238us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480634.618982:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782480634.619066:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48577800 x1869066311582848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480650 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480634.619094:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311582848:0@lo:13: 00010000:00010000:1.0:1782480635.575873:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480636.607893:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480637.622938:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480638.647716:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480638.713003:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311582976:0@lo:400: 00000100:00100000:1.0:1782480638.713087:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480638.713241:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311583488:0@lo:400: 00000100:00100000:3.0:1782480638.713255:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311583232:0@lo:400: 00000100:00100000:1.0:1782480638.713281:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480638.713345:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782480638.713352:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869066311583104:0@lo:400: 00000100:00100000:1.0:1782480638.713378:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480638.713508:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311583360:0@lo:400: 00000100:00100000:1.0:1782480638.713556:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311582976 00000100:00100000:1.0:1782480638.713563:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311582976 00000100:00100000:1.0:1782480638.713607:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1782480638.713616:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+13:3317:x1869066311582976:12345-0@lo:400: 00000100:00100000:1.0:1782480638.713664:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+13:3317:x1869066311582976:12345-0@lo:400: Request processed in 49us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480638.713672:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1782480638.713703:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311583488 00000100:00100000:1.0:1782480638.713708:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311583488 00000100:00100000:3.0:1782480638.713725:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480638.713794:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311583360 00000100:00100000:3.0:1782480638.713798:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311583360 00000100:00100000:1.0:1782480638.713931:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311583104 00000100:00100000:1.0:1782480638.713935:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311583104 00000100:00100000:1.0:1782480638.714219:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782480638.714229:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311583488:12345-0@lo:400: 00000100:00100000:3.0:1782480638.714232:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782480638.714245:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311583360:12345-0@lo:400: 00000100:00100000:1.0:1782480638.714276:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311583488:12345-0@lo:400: Request processed in 49us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480638.714283:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782480638.714300:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311583360:12345-0@lo:400: Request processed in 58us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480638.714322:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782480638.714344:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1782480638.714386:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48574380 x1869066311583360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480638.714400:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311583360:0@lo:400: 00000100:00100000:1.0:1782480638.714409:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311583232 00000100:00100000:1.0:1782480638.714414:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311583232 00000100:00100000:1.0:1782480638.714436:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782480638.714442:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869066311583104:12345-0@lo:400: 00000100:00100000:1.0:1782480638.714472:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869066311583104:12345-0@lo:400: Request processed in 30us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480638.714484:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782480638.714497:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782480638.714503:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311583232:12345-0@lo:400: 00000100:00100000:1.0:1782480638.714536:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311583232:12345-0@lo:400: Request processed in 33us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480638.714542:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1782480638.714566:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782480638.714571:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782480638.714594:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48575f80 x1869066311583104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480638.714605:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869066311583104:0@lo:400: 00010000:00080000:1.0:1782480638.714617:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48575180 x1869066311583488/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480638.714626:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311583488:0@lo:400: 00000100:00100000:1.0:1782480638.714635:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311582976:0@lo:400: 00010000:00080000:2.0:1782480638.714940:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48577480 x1869066311583232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480638.714951:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311583232:0@lo:400: 00010000:00010000:0.0:1782480639.670974:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480639.736054:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782480639.736087:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311583616:0@lo:13: 00000100:00100000:1.0:1782480639.736152:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480639.736213:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311583616 00000100:00100000:1.0:1782480639.736220:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311583616 00000100:00100000:1.0:1782480639.736261:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782480639.736269:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311583616:12345-0@lo:13: 00002000:00000024:1.0:1782480639.736315:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480639.736356:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311583616:12345-0@lo:13: Request processed in 87us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480639.736373:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1782480639.736425:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48573100 x1869066311583616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480639.736444:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311583616:0@lo:13: 00010000:00010000:3.0:1782480640.702434:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782480641.371212:0:7836:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1782480641.722275:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480642.744070:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782480642.806890:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782480642.806900:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9b6d46055800 from 30 10000000:01000000:2.0:1782480642.806906:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782480642.806951:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d000/0x3dc3ebf33c023956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480642.806963:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d000/0x3dc3ebf33c023956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480642.806975:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d000/0x3dc3ebf33c023956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480642.806998:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311583744:0@lo:101: 00000100:00100000:2.0:1782480642.807061:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480642.807106:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d756c8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782480642.808087:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311583744 00000100:00100000:3.0:1782480642.808095:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311583744 00000100:00100000:3.0:1782480642.808178:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1782480642.808188:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+13:5804:x1869066311583744:12345-0@lo:101: 00010000:00010000:3.0:1782480642.808202:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480642.808216:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d821ed600/0x3dc3ebf33c02395d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023956 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480642.808253:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d821ed600/0x3dc3ebf33c02395d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023956 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480642.808263:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d821ed600/0x3dc3ebf33c02395d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023956 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480642.808272:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ed600, rc 0) 00000100:00100000:3.0:1782480642.808337:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+14:5804:x1869066311583744:12345-0@lo:101: Request processed in 150us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480642.808344:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1782480642.808420:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311583744:0@lo:101: 00010000:00010000:2.0:1782480642.808436:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d000/0x3dc3ebf33c023956 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02395d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480642.808444:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d000/0x3dc3ebf33c023956 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c02395d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480642.808501:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311583872:0@lo:501: 00000100:00100000:2.0:1782480642.808532:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480642.812687:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d756c8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782480642.816553:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311583872 00000100:00100000:1.0:1782480642.816568:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311583872 00000100:00100000:1.0:1782480642.816621:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782480642.816631:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+14:5804:x1869066311583872:12345-0@lo:501: 00000100:00100000:1.0:1782480642.817140:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+14:5804:x1869066311583872:12345-0@lo:501: Request processed in 509us (8605us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480642.817149:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782480642.818956:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311583872:0@lo:501: 00000100:00100000:3.0:1782480642.819076:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311584000:0@lo:503: 00000100:00100000:3.0:1782480642.819150:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480642.819234:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49a70c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782480642.822275:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311584000 00000100:00100000:1.0:1782480642.822288:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311584000 00000100:00100000:1.0:1782480642.823987:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782480642.824006:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+14:5804:x1869066311584000:12345-0@lo:503: 00000100:00100000:1.0:1782480642.824413:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+14:5804:x1869066311584000:12345-0@lo:503: Request processed in 413us (5261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480642.824422:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1782480642.824893:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311584000:0@lo:503: 00000100:00100000:3.0:1782480642.825109:0:7916:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:7916:1869066311584128:0@lo:502: 00000100:00100000:3.0:1782480642.825155:0:7916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480642.829412:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311584128 00000100:00100000:2.0:1782480642.829436:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311584128 00000100:00100000:2.0:1782480642.829483:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1782480642.829491:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+14:7916:x1869066311584128:12345-0@lo:502: 00000100:00100000:2.0:1782480642.830154:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+14:7916:x1869066311584128:12345-0@lo:502: Request processed in 662us (4997us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480642.830164:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1782480642.832846:0:7916:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49a70000 going to sleep for 11 seconds 00000100:00100000:3.0:1782480642.832888:0:7916:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:7916:1869066311584128:0@lo:502: 00000100:00100000:3.0:1782480642.832969:0:7916:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:7916:1869066311584256:0@lo:502: 00000100:00100000:3.0:1782480642.833034:0:7916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480642.833062:0:7916:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49a70000 going to sleep for 11 seconds 00000100:00100000:2.0:1782480642.833200:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311584256 00000100:00100000:2.0:1782480642.833207:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311584256 00000100:00100000:2.0:1782480642.833271:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782480642.833281:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+14:7916:x1869066311584256:12345-0@lo:502: 00000100:00100000:2.0:1782480642.833510:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+14:7916:x1869066311584256:12345-0@lo:502: Request processed in 229us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480642.833517:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1782480642.833706:0:7916:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:7916:1869066311584256:0@lo:502: 00000040:00080000:3.0:1782480642.833728:0:7916:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1782480642.834865:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1782480642.834893:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782480642.834905:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d000/0x3dc3ebf33c023956 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02395d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480642.834918:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d000/0x3dc3ebf33c023956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02395d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480642.834929:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1782480642.834932:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1782480642.834935:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1782480642.834967:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c200/0x3dc3ebf33c023964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480642.834976:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c200/0x3dc3ebf33c023964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480642.834998:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c200/0x3dc3ebf33c023964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480642.835018:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311584384:0@lo:101: 00000100:00100000:2.0:1782480642.835064:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480642.835098:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d756c8840 going to sleep for 11 seconds 00000100:00100000:3.0:1782480642.835880:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311584384 00000100:00100000:3.0:1782480642.835889:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311584384 00000100:00100000:3.0:1782480642.835941:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1782480642.835951:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+14:5804:x1869066311584384:12345-0@lo:101: 00010000:00010000:3.0:1782480642.835966:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480642.835979:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d821ec000/0x3dc3ebf33c02396b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023964 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480642.836006:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d821ec000/0x3dc3ebf33c02396b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023964 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480642.836018:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d821ec000/0x3dc3ebf33c02396b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023964 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480642.836028:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ec000, rc 0) 00000100:00100000:3.0:1782480642.836082:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+15:5804:x1869066311584384:12345-0@lo:101: Request processed in 132us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480642.836089:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1782480642.836182:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311584384:0@lo:101: 00010000:00010000:2.0:1782480642.836197:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c200/0x3dc3ebf33c023964 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02396b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480642.836206:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c200/0x3dc3ebf33c023964 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c02396b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480642.836281:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311584512:0@lo:501: 00000100:00100000:2.0:1782480642.836309:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480642.836346:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d756c8840 going to sleep for 11 seconds 00000100:00100000:2.0:1782480642.836360:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311584512 00000100:00100000:2.0:1782480642.836364:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311584512 00000100:00100000:2.0:1782480642.836385:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1782480642.836391:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+15:5804:x1869066311584512:12345-0@lo:501: 00000100:00100000:2.0:1782480642.836621:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+15:5804:x1869066311584512:12345-0@lo:501: Request processed in 228us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480642.836628:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1782480642.836658:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311584512:0@lo:501: 00000100:00100000:2.0:1782480642.836684:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311584640:0@lo:503: 00000100:00100000:2.0:1782480642.836726:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480642.836739:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d43f50f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782480642.836850:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311584640 00000100:00100000:2.0:1782480642.836855:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311584640 00000100:00100000:2.0:1782480642.836871:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782480642.836877:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+15:5804:x1869066311584640:12345-0@lo:503: 00000100:00100000:2.0:1782480642.837155:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+15:5804:x1869066311584640:12345-0@lo:503: Request processed in 277us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480642.837162:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782480642.837195:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311584640:0@lo:503: 00000100:00100000:2.0:1782480642.841260:0:7918:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:7918:1869066311584768:0@lo:502: 00000100:00100000:2.0:1782480642.841335:0:7918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480642.841375:0:7918:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d43f50480 going to sleep for 11 seconds 00000100:00100000:3.0:1782480642.841428:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311584768 00000100:00100000:3.0:1782480642.841435:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311584768 00000100:00100000:3.0:1782480642.841484:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1782480642.841493:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+15:7918:x1869066311584768:12345-0@lo:502: 00000100:00100000:3.0:1782480642.841866:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+15:7918:x1869066311584768:12345-0@lo:502: Request processed in 372us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480642.841874:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782480642.842002:0:7918:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:7918:1869066311584768:0@lo:502: 00000020:01000000:2.0:1782480642.842032:0:7918:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782480642.842041:0:7918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480642.842044:0:7918:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782480642.842048:0:7918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782480642.842050:0:7918:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1782480642.842067:0:7918:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:7918:1869066311584896:0@lo:502: 00000100:00100000:2.0:1782480642.842096:0:7918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480642.842124:0:7918:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f38ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480642.842168:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311584896 00000100:00100000:3.0:1782480642.842173:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311584896 00000100:00100000:3.0:1782480642.845474:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1782480642.845497:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+15:7918:x1869066311584896:12345-0@lo:502: 00000100:00100000:3.0:1782480642.845789:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+15:7918:x1869066311584896:12345-0@lo:502: Request processed in 302us (3691us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480642.845798:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782480642.847929:0:7918:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:7918:1869066311584896:0@lo:502: 00000020:01000000:0.0:1782480642.847974:0:7918:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782480642.847981:0:7918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480642.847984:0:7918:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782480642.847990:0:7918:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1782480642.852052:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1782480642.852089:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782480642.852100:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c200/0x3dc3ebf33c023964 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02396b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480642.852114:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c200/0x3dc3ebf33c023964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02396b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480642.852126:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782480642.852130:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9b6d47c9a800 from 30 10000000:01000000:3.0:1782480642.852133:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782480642.852182:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480642.852191:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480642.852202:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480642.852237:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311585024:0@lo:101: 00000100:00100000:3.0:1782480642.852302:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480642.852348:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49a70f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480642.852367:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311585024 00000100:00100000:3.0:1782480642.852372:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311585024 00000100:00100000:3.0:1782480642.852408:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782480642.852417:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d68bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+15:5804:x1869066311585024:12345-0@lo:101: 00010000:00010000:3.0:1782480642.852430:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480642.852441:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d821eda00/0x3dc3ebf33c023979 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023972 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480642.852465:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d821eda00/0x3dc3ebf33c023979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023972 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480642.852475:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d821eda00/0x3dc3ebf33c023979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023972 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480642.852484:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821eda00, rc 0) 00000100:00100000:3.0:1782480642.852520:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d68bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+16:5804:x1869066311585024:12345-0@lo:101: Request processed in 103us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480642.852526:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782480642.852578:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311585024:0@lo:101: 00010000:00010000:3.0:1782480642.852592:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023979 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480642.852601:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023979 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480642.852646:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311585152:0@lo:501: 00000100:00100000:3.0:1782480642.852669:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480642.852683:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49a70f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480642.852695:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311585152 00000100:00100000:3.0:1782480642.852698:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311585152 00000100:00100000:3.0:1782480642.852716:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782480642.852721:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d68bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+16:5804:x1869066311585152:12345-0@lo:501: 00000100:00100000:3.0:1782480642.855345:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d68bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+16:5804:x1869066311585152:12345-0@lo:501: Request processed in 2615us (2668us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480642.855356:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782480642.855886:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311585152:0@lo:501: 00000100:00100000:2.0:1782480642.855940:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311585280:0@lo:503: 00000100:00100000:2.0:1782480642.855985:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480642.856017:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d43f50480 going to sleep for 11 seconds 00000100:00100000:3.0:1782480642.856105:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311585280 00000100:00100000:3.0:1782480642.856113:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311585280 00000100:00100000:3.0:1782480642.856147:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1782480642.856154:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d68bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+16:5804:x1869066311585280:12345-0@lo:503: 00000100:00100000:3.0:1782480642.856324:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d68bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+16:5804:x1869066311585280:12345-0@lo:503: Request processed in 169us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480642.856332:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782480642.856924:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311585280:0@lo:503: 00000100:00100000:2.0:1782480642.862047:0:7920:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:7920:1869066311585408:0@lo:502: 00000100:00100000:2.0:1782480642.862136:0:7920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480642.862179:0:7920:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46016cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480642.862250:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311585408 00000100:00100000:3.0:1782480642.862258:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311585408 00000100:00100000:3.0:1782480642.862306:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782480642.862315:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d68bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+16:7920:x1869066311585408:12345-0@lo:502: 00000100:00100000:3.0:1782480642.862576:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d68bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+16:7920:x1869066311585408:12345-0@lo:502: Request processed in 260us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480642.862584:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782480642.862673:0:7920:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:7920:1869066311585408:0@lo:502: 00000100:00100000:0.0:1782480642.862723:0:7920:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:7920:1869066311585536:0@lo:502: 00000100:00100000:0.0:1782480642.862791:0:7920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480642.862818:0:7920:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d751db780 going to sleep for 11 seconds 00000100:00100000:3.0:1782480642.862931:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311585536 00000100:00100000:3.0:1782480642.862935:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311585536 00000100:00100000:3.0:1782480642.862969:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782480642.862975:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+16:7920:x1869066311585536:12345-0@lo:502: 00000100:00100000:3.0:1782480642.863099:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+16:7920:x1869066311585536:12345-0@lo:502: Request processed in 124us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480642.863106:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782480642.863217:0:7920:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:7920:1869066311585536:0@lo:502: 00000040:00080000:0.0:1782480642.863248:0:7920:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1782480642.863400:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1782480642.863421:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782480642.863431:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023972 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023979 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480642.863442:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023979 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480642.863451:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1782480642.863454:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9b6d47c9a800 from 5 10000000:01000000:2.0:1782480642.863457:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782480642.863481:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873ca00/0x3dc3ebf33c023980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480642.863489:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d6873ca00/0x3dc3ebf33c023980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480642.863498:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d6873ca00/0x3dc3ebf33c023980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480642.863512:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311585664:0@lo:101: 00000100:00100000:2.0:1782480642.863539:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480642.863561:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d460160c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480642.863606:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311585664 00000100:00100000:3.0:1782480642.863610:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311585664 00000100:00100000:3.0:1782480642.863640:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782480642.863646:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+16:5804:x1869066311585664:12345-0@lo:101: 00010000:00010000:3.0:1782480642.863654:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480642.863666:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d821ed200/0x3dc3ebf33c023987 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023980 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480642.863686:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d821ed200/0x3dc3ebf33c023987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023980 expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480642.863696:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d821ed200/0x3dc3ebf33c023987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023980 expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480642.863705:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ed200, rc 0) 00000100:00100000:0.0:1782480642.863892:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311585664:0@lo:101: 00010000:00010000:0.0:1782480642.863904:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d6873ca00/0x3dc3ebf33c023980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023987 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480642.863914:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d6873ca00/0x3dc3ebf33c023980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023987 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480642.863955:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311585792:0@lo:256: 00000100:00100000:0.0:1782480642.863983:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480642.864010:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d751db780 going to sleep for 11 seconds 00000100:00100000:2.0:1782480642.864060:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311585792 00000100:00100000:2.0:1782480642.864064:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311585792 00000100:00100000:2.0:1782480642.864093:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1782480642.864099:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311585792:12345-0@lo:256: 20000000:01000000:2.0:1782480642.864117:0:5801:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782480642.864131:0:5801:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782480642.864134:0:5801:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1782480642.864203:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311585792:12345-0@lo:256: Request processed in 104us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480642.864211:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1782480642.864252:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311585792:0@lo:256: 10000000:01000000:2.0:1782480642.864290:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782480642.864296:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873ca00/0x3dc3ebf33c023980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023987 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480642.864304:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d6873ca00/0x3dc3ebf33c023980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023987 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480642.864311:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782480642.864313:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1782480642.864315:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782480642.864329:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c800/0x3dc3ebf33c02398e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480642.864338:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c800/0x3dc3ebf33c02398e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480642.864346:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c800/0x3dc3ebf33c02398e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480642.864357:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311585920:0@lo:101: 00000100:00100000:2.0:1782480642.864380:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480642.864392:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46016840 going to sleep for 11 seconds 00000100:00100000:2.0:1782480642.864408:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311585920 00000100:00100000:2.0:1782480642.864412:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311585920 00000100:00100000:2.0:1782480642.864427:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782480642.864432:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311585920:12345-0@lo:101: 00010000:00010000:2.0:1782480642.864439:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480642.864447:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d6873cc00/0x3dc3ebf33c023995 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c02398e expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480642.864462:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d6873cc00/0x3dc3ebf33c023995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c02398e expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480642.864470:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d6873cc00/0x3dc3ebf33c023995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c02398e expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480642.864478:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6873cc00, rc 0) 00000100:00100000:2.0:1782480642.864504:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311585920:12345-0@lo:101: Request processed in 71us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480642.864510:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782480642.864536:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311585920:0@lo:101: 00010000:00010000:2.0:1782480642.864546:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c800/0x3dc3ebf33c02398e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023995 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480642.864554:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c800/0x3dc3ebf33c02398e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023995 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480642.864588:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311586048:0@lo:501: 00000100:00100000:2.0:1782480642.864611:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480642.864622:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46016840 going to sleep for 11 seconds 00000100:00100000:2.0:1782480642.864632:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311586048 00000100:00100000:2.0:1782480642.864640:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311586048 00000100:00100000:2.0:1782480642.864657:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782480642.864663:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311586048:12345-0@lo:501: 00000100:00100000:3.0:1782480642.864846:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311585664:12345-0@lo:101: Request processed in 1200us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480642.864854:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1782480642.865129:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311586048:12345-0@lo:501: Request processed in 465us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480642.865136:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782480642.874064:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311586048:0@lo:501: 00000100:00100000:3.0:1782480642.874131:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48576300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311586176:0@lo:503: 00000100:00100000:3.0:1782480642.874207:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480642.874269:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49a70c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782480642.874338:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311586176 00000100:00100000:2.0:1782480642.874346:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311586176 00000100:00100000:2.0:1782480642.874394:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1782480642.874404:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311586176:12345-0@lo:503: 00000100:00100000:2.0:1782480642.874785:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311586176:12345-0@lo:503: Request processed in 381us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480642.874793:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782480642.875306:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48576300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311586176:0@lo:503: 00000100:00100000:1.0:1782480642.881980:0:7921:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48573100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:7921:1869066311586304:0@lo:502: 00000100:00100000:1.0:1782480642.882069:0:7921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480642.882117:0:7921:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45f6ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480642.882353:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311586304 00000100:00100000:3.0:1782480642.882362:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311586304 00000100:00100000:3.0:1782480642.882406:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782480642.882427:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+18:7921:x1869066311586304:12345-0@lo:502: 00000100:00100000:3.0:1782480642.882733:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+18:7921:x1869066311586304:12345-0@lo:502: Request processed in 306us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480642.882741:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782480642.883359:0:7921:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48573100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:7921:1869066311586304:0@lo:502: 00000020:01000000:1.0:1782480642.883394:0:7921:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782480642.883402:0:7921:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1782480642.883417:0:7921:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480642.883419:0:7921:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1782480642.883428:0:7921:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782480642.883432:0:7921:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:1.0:1782480642.883453:0:7921:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1782480642.883455:0:7921:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782480642.883469:0:7921:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b6d7562b380) 00000020:00000080:1.0:1782480642.883491:0:7921:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1782480642.883497:0:7921:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782480642.883569:0:7921:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1782480642.883574:0:7921:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1782480642.883580:0:7921:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3dc3ebf33c0239a3 00010000:00080000:1.0:1782480642.883608:0:7921:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6d75818000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:1.0:1782480642.883926:0:7921:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1782480642.884238:0:7921:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1782480642.884251:0:7921:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1782480642.885341:0:7921:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782480642.885599:0:7921:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782480642.885645:0:7921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1782480642.885695:0:7921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1782480642.886143:0:7922:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782480642.886147:0:7922:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1782480642.886793:0:7921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782480642.886805:0:7921:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1782480642.886836:0:7921:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1782480642.886856:0:7921:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3dc3ebf33c0239aa 00000100:00080000:3.0:1782480642.886866:0:7921:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782480642.886872:0:7921:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b6d75818000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1782480642.886902:0:7921:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d48576300 x1869066311586432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782480642.886925:0:7921:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1782480642.886971:0:7921:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782480642.886975:0:7921:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480642.886983:0:7921:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1782480642.886987:0:7921:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782480642.886992:0:7921:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480642.886993:0:7921:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782480642.886996:0:7921:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782480642.886998:0:7921:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1782480642.887024:0:7921:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48575880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:7921:1869066311586560:0@lo:502: 00000100:00100000:3.0:1782480642.887095:0:7921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480642.887129:0:7921:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49a70f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782480642.887299:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1869066311586432:0@lo:8: 00000100:00100000:0.0:1782480642.887333:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480642.887373:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311586560 00000100:00100000:0.0:1782480642.887379:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311586560 00000100:00100000:0.0:1782480642.887412:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782480642.887419:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+18:7921:x1869066311586560:12345-0@lo:502: 00000100:00100000:0.0:1782480642.887624:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+18:7921:x1869066311586560:12345-0@lo:502: Request processed in 204us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480642.887631:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782480642.887669:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311586432 00000100:00100000:0.0:1782480642.887673:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311586432 00000100:00100000:0.0:1782480642.887693:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782480642.887698:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3314:x1869066311586432:12345-0@lo:8: 00010000:00080000:0.0:1782480642.887717:0:6604:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:0.0:1782480642.887744:0:6604:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3dc3ebf33c0239b1 00002000:00100000:0.0:1782480642.887789:0:6604:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b6c41879800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211365f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1782480642.887793:0:6604:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1782480642.887796:0:6604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1782480642.887896:0:6604:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1782480642.888029:0:6604:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782480642.888050:0:6604:0:(import.c:65:import_set_state_nolock()) ffff9b6c4187c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782480642.888089:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1869066311586432:12345-0@lo:8: Request processed in 390us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480642.888096:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1782480642.888149:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48576300 x1869066311586432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782480652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480642.888171:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782480642.888179:0:3314:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1782480642.888187:0:3314:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1782480642.888192:0:3314:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1782480642.888194:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9b6d75818000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1782480642.888201:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1782480642.888207:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1869066311586432:0@lo:8: 00000100:00100000:1.0:1782480642.890030:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311586944:0@lo:400: 00000100:00100000:1.0:1782480642.890083:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480642.890111:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782480642.890117:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311587072:0@lo:400: 00000100:00100000:1.0:1782480642.890140:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480642.890167:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311587072 00000100:00100000:1.0:1782480642.890173:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311587072 00000100:00100000:1.0:1782480642.890219:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782480642.890244:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4737b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311587072:12345-0@lo:400: 00000100:00100000:1.0:1782480642.890294:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4737b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311587072:12345-0@lo:400: Request processed in 52us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480642.890309:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1782480642.890329:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782480642.890357:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d4737b100 x1869066311587072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480642.890370:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311587072:0@lo:400: 00000004:00080000:1.0:1782480642.890391:0:7922:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1782480642.890507:0:7922:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 263731758744ns, next at 0ns, rc = 0 00000100:00100000:0.0:1782480642.890586:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311586688:0@lo:400: 00000100:00100000:0.0:1782480642.890616:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480642.890643:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782480642.890649:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311586816:0@lo:400: 00000100:00100000:0.0:1782480642.890670:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480642.890698:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311586688 00000100:00100000:0.0:1782480642.890702:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311586688 00000100:00100000:0.0:1782480642.890725:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311586816 00000100:00100000:0.0:1782480642.890728:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311586816 00000100:00100000:0.0:1782480642.890779:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782480642.890786:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311586688:12345-0@lo:400: 00000100:00100000:0.0:1782480642.890820:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311586688:12345-0@lo:400: Request processed in 35us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480642.890826:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782480642.890837:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782480642.890842:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311586816:12345-0@lo:400: 00000100:00100000:0.0:1782480642.890862:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311586816:12345-0@lo:400: Request processed in 20us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480642.890867:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1782480642.890887:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782480642.890902:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48572d80 x1869066311586816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480642.890912:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311586816:0@lo:400: 00010000:00080000:0.0:1782480642.890920:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48573100 x1869066311586688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480642.890927:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311586688:0@lo:400: 00000100:00100000:3.0:1782480642.891124:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311586944 00000100:00100000:3.0:1782480642.891129:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311586944 00000100:00100000:3.0:1782480642.891163:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782480642.891169:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311586944:12345-0@lo:400: 00000100:00100000:3.0:1782480642.891208:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311586944:12345-0@lo:400: Request processed in 40us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480642.891214:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1782480642.891249:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48571c00 x1869066311586944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480642.891258:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311586944:0@lo:400: 00000100:00100000:3.0:1782480642.891282:0:7921:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48575880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:7921:1869066311586560:0@lo:502: 00000020:01000000:3.0:1782480642.891315:0:7921:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782480642.891321:0:7921:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480642.891324:0:7921:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782480642.891328:0:7921:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1782480642.891388:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1782480642.891406:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782480642.891415:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c800/0x3dc3ebf33c02398e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023995 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480642.891437:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c800/0x3dc3ebf33c02398e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023995 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480642.891447:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782480642.891449:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9b6d4845cd40 from 1 10000000:01000000:3.0:1782480642.891452:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782480642.891477:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821ece00/0x3dc3ebf33c0239b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480642.891485:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d821ece00/0x3dc3ebf33c0239b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480642.891494:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d821ece00/0x3dc3ebf33c0239b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480642.891510:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48575880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311587200:0@lo:101: 00000100:00100000:3.0:1782480642.891537:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480642.891560:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d5239d240 going to sleep for 11 seconds 00000100:00100000:0.0:1782480642.893250:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311587200 00000100:00100000:0.0:1782480642.893262:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311587200 00000100:00100000:0.0:1782480642.893304:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782480642.893312:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311587200:12345-0@lo:101: 00010000:00010000:0.0:1782480642.893327:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480642.893343:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40031800/0x3dc3ebf33c0239bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c0239b8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480642.893372:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40031800/0x3dc3ebf33c0239bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c0239b8 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480642.893383:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40031800/0x3dc3ebf33c0239bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c0239b8 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480642.893392:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40031800, rc 0) 00000100:00100000:0.0:1782480642.893455:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311587200:12345-0@lo:101: Request processed in 143us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480642.893462:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1782480642.893862:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480642.894115:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48575880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311587200:0@lo:101: 00010000:00010000:3.0:1782480642.894135:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d821ece00/0x3dc3ebf33c0239b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c0239bf expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480642.894144:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d821ece00/0x3dc3ebf33c0239b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c0239bf expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480642.894204:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48575880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311587328:0@lo:501: 00000100:00100000:3.0:1782480642.894250:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480642.894338:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d5239d240 going to sleep for 11 seconds 00000100:00100000:1.0:1782480642.904109:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311587328 00000100:00100000:1.0:1782480642.904122:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311587328 00000100:00100000:1.0:1782480642.904188:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1782480642.904198:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311587328:12345-0@lo:501: 00000100:00100000:1.0:1782480642.904461:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311587328:12345-0@lo:501: Request processed in 265us (10209us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782480642.904470:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1782480642.904515:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48575880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311587328:0@lo:501: 10000000:01000000:1.0:1782480642.904554:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782480642.904564:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821ece00/0x3dc3ebf33c0239b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c0239bf expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480642.904574:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d821ece00/0x3dc3ebf33c0239b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c0239bf expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782480643.054902:0:7923:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1782480643.054931:0:7923:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7923:1869066311587584:0@lo:7: 00000100:00100000:2.0:1782480643.055183:0:7923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480643.055271:0:7923:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45d65f00 going to sleep for 11 seconds 00000004:00080000:2.0:1782480643.055294:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1782480643.055329:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311587456:0@lo:13: 00000100:00100000:2.0:1782480643.055355:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480643.057231:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311587456 00000100:00100000:1.0:1782480643.057244:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311587456 00000100:00100000:1.0:1782480643.057310:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782480643.057320:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869066311587456:12345-0@lo:13: 00002000:00000024:1.0:1782480643.057362:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1782480643.057426:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869066311587456:12345-0@lo:13: Request processed in 108us (2069us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480643.057434:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1782480643.057481:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7ac1e680 x1869066311587456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480643.057510:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311587456:0@lo:13: 00000100:00080000:0.0:1782480643.057620:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782480643.058699:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311587584 00000100:00100000:3.0:1782480643.058707:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311587584 00000100:00100000:3.0:1782480643.058761:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782480643.058769:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7923:x1869066311587584:12345-0@lo:7: 00002000:00080000:2.0:1782480643.069913:0:6602:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1782480643.069922:0:6602:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1782480643.070008:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7923:x1869066311587584:12345-0@lo:7: Request processed in 11236us (14822us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480643.070020:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1782480643.070357:0:7923:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7ac1c000 x1869066311587584/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782480659 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480643.070384:0:7923:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7923:1869066311587584:0@lo:7: 00000004:00080000:0.0:1782480643.070397:0:7923:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1782480643.070435:0:7923:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7923:1869066311587712:0@lo:5: 00000100:00100000:0.0:1782480643.070470:0:7923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480643.070528:0:7923:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d756c8600 going to sleep for 11 seconds 00000100:00100000:3.0:1782480643.070584:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311587712 00000100:00100000:3.0:1782480643.070591:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311587712 00000100:00100000:3.0:1782480643.070638:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782480643.070646:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7923:x1869066311587712:12345-0@lo:5: 00002000:00080000:3.0:1782480643.070671:0:6604:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1782480643.070675:0:6604:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1782480643.070905:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7923:x1869066311587712:12345-0@lo:5: Request processed in 260us (434us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1782480643.070912:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1782480643.070940:0:7923:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d460b2d80 x1869066311587712/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782480659 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480643.070951:0:7923:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7923:1869066311587712:0@lo:5: 00000004:00080000:3.0:1782480643.070962:0:7923:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1782480643.070996:0:7923:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7923:1869066311587840:0@lo:700: 00000100:00100000:3.0:1782480643.071019:0:7923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480643.071033:0:7923:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d5239df00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480643.071048:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311587840 00000100:00100000:3.0:1782480643.071051:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311587840 00000100:00100000:1.0:1782480643.072284:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782480643.072299:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7923:x1869066311587840:12345-0@lo:700: 00000100:00100000:1.0:1782480643.072343:0:6612:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6612:1869066311587968:0@lo:700: 00000100:00100000:1.0:1782480643.072382:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480643.072411:0:6612:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51c33000 going to sleep for 11 seconds 00000100:00100000:2.0:1782480643.072459:0:5814:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311587968 00000100:00100000:2.0:1782480643.072476:0:5814:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311587968 00000100:00100000:2.0:1782480643.072998:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782480643.073015:0:5814:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4737a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6612:x1869066311587968:12345-0@lo:700: 40000000:02000000:3.0:1782480643.144948:0:5814:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1782480643.160833:0:5814:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4737a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6612:x1869066311587968:12345-0@lo:700: Request processed in 87810us (88441us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480643.160847:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782480643.161216:0:6612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d4737b100 x1869066311587968/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782480659 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480643.161248:0:6612:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6612:1869066311587968:0@lo:700: 40000000:02000000:1.0:1782480643.161262:0:6612:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:2.0:1782480643.286683:0:7497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1782480643.286709:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1782480643.286871:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7923:x1869066311587840:12345-0@lo:700: Request processed in 214572us (215845us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480643.286883:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782480643.287151:0:7923:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48574a80 x1869066311587840/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782480659 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480643.287164:0:7923:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1782480643.287183:0:7923:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7923:1869066311587840:0@lo:700: 00000004:02000040:3.0:1782480643.314975:0:7923:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1782480643.319108:0:7923:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7923:1869066311588096:0@lo:5: 00000100:00100000:3.0:1782480643.319184:0:7923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480643.319264:0:7923:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d751db9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480643.319575:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311588096 00000100:00100000:2.0:1782480643.319585:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311588096 00000100:00100000:2.0:1782480643.319640:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782480643.319650:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7923:x1869066311588096:12345-0@lo:5: 00002000:00080000:3.0:1782480643.328490:0:6602:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1782480643.328515:0:6602:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1782480643.331300:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7923:x1869066311588096:12345-0@lo:5: Request processed in 11643us (12109us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1782480643.331313:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1782480643.331456:0:7923:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48574a80 x1869066311588096/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782480659 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480643.331473:0:7923:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7923:1869066311588096:0@lo:5: 00000004:00080000:1.0:1782480643.331488:0:7923:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1782480643.766904:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480644.791466:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480644.855004:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311588224:0@lo:13: 00000100:00100000:1.0:1782480644.855075:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480644.855158:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311588224 00000100:00100000:1.0:1782480644.855165:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311588224 00000100:00100000:1.0:1782480644.855455:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782480644.855466:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4737ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311588224:12345-0@lo:13: 00002000:00000024:1.0:1782480644.855504:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480644.855560:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4737ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311588224:12345-0@lo:13: Request processed in 96us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480644.855568:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1782480644.855590:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782480644.856116:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d4737b100 x1869066311588224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480660 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480644.856138:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311588224:0@lo:13: 00010000:00010000:0.0:1782480645.815783:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782480646.032383:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1782480646.395307:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480646.395384:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291642496 00000100:00100000:2.0:1782480646.395393:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291642496 00000100:00100000:2.0:1782480646.395441:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 110 00000100:00100000:2.0:1782480646.395449:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2365:x1869066291642496:12345-192.168.204.51@tcp:250: 00010000:00080000:2.0:1782480646.395478:0:5799:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 5e04a3c2-7108-4d15-9896-eb6ad232c4d6@192.168.204.51@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:2.0:1782480646.395505:0:5799:0:(genops.c:1406:class_connect()) connect: client 5e04a3c2-7108-4d15-9896-eb6ad232c4d6, cookie 0x3dc3ebf33c0239c6 00000100:00080000:2.0:1782480646.395634:0:5799:0:(import.c:65:import_set_state_nolock()) ffff9b6d74c75800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782480646.395713:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+5:2365:x1869066291642496:12345-192.168.204.51@tcp:250: Request processed in 264us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480646.395722:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 110 00000100:00100000:1.0:1782480646.401435:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480646.401592:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291642624 00000100:00100000:3.0:1782480646.401602:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291642624 00000100:00100000:3.0:1782480646.401654:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 111 00000100:00100000:3.0:1782480646.401670:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+5:5569:x1869066291642624:12345-192.168.204.51@tcp:101: 00010000:00010000:3.0:1782480646.401685:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480646.401699:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d821ec200/0x3dc3ebf33c0239cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f704 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480646.401725:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d821ec200/0x3dc3ebf33c0239cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f704 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480646.401735:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d821ec200/0x3dc3ebf33c0239cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f704 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480646.401776:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ec200, rc 0) 00000100:00100000:3.0:1782480646.401821:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+6:5569:x1869066291642624:12345-192.168.204.51@tcp:101: Request processed in 160us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480646.401827:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 111 00000100:00100000:2.0:1782480646.435321:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480646.435555:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291642752 00000100:00100000:3.0:1782480646.435566:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291642752 00000100:00100000:3.0:1782480646.435615:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 112 00000100:00100000:3.0:1782480646.435625:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+6:5569:x1869066291642752:12345-192.168.204.51@tcp:501: 00000100:00100000:3.0:1782480646.436056:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+6:5569:x1869066291642752:12345-192.168.204.51@tcp:501: Request processed in 431us (744us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782480646.436065:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 112 00000100:00100000:1.0:1782480646.457168:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480646.458719:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291642880 00000100:00100000:2.0:1782480646.458733:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291642880 00000100:00100000:2.0:1782480646.458804:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 113 00000100:00100000:2.0:1782480646.458813:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+6:5569:x1869066291642880:12345-192.168.204.51@tcp:101: 00010000:00010000:2.0:1782480646.458838:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480646.458854:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d6873d800/0x3dc3ebf33c0239d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f70b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480646.458885:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d6873d800/0x3dc3ebf33c0239d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f70b expref: 7 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480646.458897:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d6873d800/0x3dc3ebf33c0239d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f70b expref: 7 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480646.458908:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6873d800, rc 0) 00000100:00100000:2.0:1782480646.458976:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+7:5569:x1869066291642880:12345-192.168.204.51@tcp:101: Request processed in 164us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480646.458983:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 113 00000100:00100000:2.0:1782480646.462909:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480646.462989:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291643008 00000100:00100000:3.0:1782480646.463001:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291643008 00000100:00100000:3.0:1782480646.463056:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 114 00000100:00100000:3.0:1782480646.463066:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+7:5569:x1869066291643008:12345-192.168.204.51@tcp:501: 00000100:00100000:3.0:1782480646.463545:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+8:5569:x1869066291643008:12345-192.168.204.51@tcp:501: Request processed in 479us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480646.463555:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 114 00000100:00100000:0.0:1782480646.466210:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480646.466243:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291643136 00000100:00100000:0.0:1782480646.466253:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291643136 00000100:00100000:0.0:1782480646.466298:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00100000:0.0:1782480646.466320:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+8:5569:x1869066291643136:12345-192.168.204.51@tcp:503: 00000100:00100000:0.0:1782480646.466961:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+8:5569:x1869066291643136:12345-192.168.204.51@tcp:503: Request processed in 652us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480646.466971:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00100000:1.0:1782480646.473700:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480646.473828:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291643264 00000100:00100000:2.0:1782480646.473838:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291643264 00000100:00100000:2.0:1782480646.473894:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:2.0:1782480646.473904:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+8:5587:x1869066291643264:12345-192.168.204.51@tcp:502: 00000100:00100000:2.0:1782480646.474228:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+8:5587:x1869066291643264:12345-192.168.204.51@tcp:502: Request processed in 324us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480646.474236:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:0.0:1782480646.514188:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480646.514270:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291643392 00000100:00100000:3.0:1782480646.514282:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291643392 00000100:00100000:3.0:1782480646.514516:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:3.0:1782480646.514527:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+8:5587:x1869066291643392:12345-192.168.204.51@tcp:502: 00000100:00100000:3.0:1782480646.514970:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+8:5587:x1869066291643392:12345-192.168.204.51@tcp:502: Request processed in 444us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480646.514988:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:1.0:1782480646.539509:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480646.539612:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291643520 00000100:00100000:1.0:1782480646.539621:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291643520 00000100:00100000:1.0:1782480646.540583:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 118 00000100:00100000:1.0:1782480646.540596:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+8:5569:x1869066291643520:12345-192.168.204.51@tcp:101: 00010000:00010000:1.0:1782480646.540615:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480646.540631:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d82164c00/0x3dc3ebf33c0239db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f735 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480646.540658:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d82164c00/0x3dc3ebf33c0239db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f735 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480646.540813:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d82164c00/0x3dc3ebf33c0239db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f735 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480646.540833:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d82164c00, rc 0) 00000100:00100000:1.0:1782480646.540885:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+9:5569:x1869066291643520:12345-192.168.204.51@tcp:101: Request processed in 293us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480646.540892:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 118 00000100:00100000:0.0:1782480646.544801:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480646.544897:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291643648 00000100:00100000:1.0:1782480646.544906:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291643648 00000100:00100000:1.0:1782480646.544951:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00100000:1.0:1782480646.544960:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+9:5569:x1869066291643648:12345-192.168.204.51@tcp:256: 20000000:01000000:1.0:1782480646.544981:0:5799:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1782480646.544998:0:5799:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1782480646.545002:0:5799:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1782480646.545005:0:5799:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1782480646.545007:0:5799:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1782480646.549991:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+9:5569:x1869066291643648:12345-192.168.204.51@tcp:256: Request processed in 5020us (5187us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480646.550006:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00100000:1.0:1782480646.553210:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480646.553258:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291643776 00000100:00100000:3.0:1782480646.553268:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291643776 00000100:00100000:3.0:1782480646.553464:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:3.0:1782480646.553475:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+9:5569:x1869066291643776:12345-192.168.204.51@tcp:101: 00010000:00010000:3.0:1782480646.553492:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480646.553509:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d821ec800/0x3dc3ebf33c0239e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f73c expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480646.553536:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d821ec800/0x3dc3ebf33c0239e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f73c expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480646.553548:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d821ec800/0x3dc3ebf33c0239e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f73c expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480646.553558:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ec800, rc 0) 00000100:00100000:3.0:1782480646.553614:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:5569:x1869066291643776:12345-192.168.204.51@tcp:101: Request processed in 142us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480646.553621:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:0.0:1782480646.555541:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480646.555788:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291643904 00000100:00100000:1.0:1782480646.555797:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291643904 00000100:00100000:1.0:1782480646.555846:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:1.0:1782480646.555855:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:5569:x1869066291643904:12345-192.168.204.51@tcp:501: 00000100:00100000:1.0:1782480646.556088:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:5569:x1869066291643904:12345-192.168.204.51@tcp:501: Request processed in 234us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480646.556096:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:2.0:1782480646.558443:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480646.558515:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291644032 00000100:00100000:3.0:1782480646.558524:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291644032 00000100:00100000:3.0:1782480646.558583:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:3.0:1782480646.558593:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:5569:x1869066291644032:12345-192.168.204.51@tcp:503: 00000100:00100000:3.0:1782480646.559191:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:5569:x1869066291644032:12345-192.168.204.51@tcp:503: Request processed in 598us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480646.559201:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:2.0:1782480646.564525:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480646.564696:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291644160 00000100:00100000:3.0:1782480646.564719:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291644160 00000100:00100000:3.0:1782480646.564787:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:3.0:1782480646.564798:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:5591:x1869066291644160:12345-192.168.204.51@tcp:502: 00000100:00100000:3.0:1782480646.565144:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:5591:x1869066291644160:12345-192.168.204.51@tcp:502: Request processed in 346us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480646.565163:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:0.0:1782480646.574099:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480646.574246:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291644288 00000100:00100000:3.0:1782480646.574257:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291644288 00000100:00100000:3.0:1782480646.574313:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 124 00000100:00100000:3.0:1782480646.574324:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:5591:x1869066291644288:12345-192.168.204.51@tcp:502: 00000100:00100000:3.0:1782480646.574582:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:5591:x1869066291644288:12345-192.168.204.51@tcp:502: Request processed in 258us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480646.574787:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 124 00000100:00100000:2.0:1782480646.579235:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480646.579390:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291644416 00000100:00100000:0.0:1782480646.579399:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291644416 00000100:00100000:0.0:1782480646.579460:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:0.0:1782480646.579468:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2365:x1869066291644416:12345-192.168.204.51@tcp:38: 00010000:00080000:0.0:1782480646.579498:0:5809:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:0.0:1782480646.579549:0:5809:0:(genops.c:1406:class_connect()) connect: client 49099535-dcd3-436f-aa96-9770a3f52e5b, cookie 0x3dc3ebf33c0239e9 00000004:00100000:0.0:1782480646.579579:0:5809:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1782480646.579738:0:5809:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1782480646.625545:0:5809:0:(import.c:65:import_set_state_nolock()) ffff9b6c4187d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782480646.625646:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2365:x1869066291644416:12345-192.168.204.51@tcp:38: Request processed in 46175us (46419us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480646.625658:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00010000:00010000:3.0:1782480646.838908:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480647.637059:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480647.637693:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291644544 00000100:00100000:1.0:1782480647.637718:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291644544 00000100:00100000:1.0:1782480647.637824:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:1.0:1782480647.637834:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+6:0:x1869066291644544:12345-192.168.204.51@tcp:41: 00000004:00000024:1.0:1782480647.637873:0:5807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782480647.637953:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+6:0:x1869066291644544:12345-192.168.204.51@tcp:41: Request processed in 121us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480647.637961:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00080000:0.0:1782480647.638070:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480647.653260:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480647.653512:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291644672 00000100:00100000:0.0:1782480647.653523:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291644672 00000100:00100000:0.0:1782480647.653613:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:0.0:1782480647.653624:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:5569:x1869066291644672:12345-192.168.204.51@tcp:41: 00000004:00000024:0.0:1782480647.653681:0:5809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782480647.653793:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:5569:x1869066291644672:12345-192.168.204.51@tcp:41: Request processed in 171us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480647.653801:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:3.0:1782480647.656618:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480647.656863:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291644800 00000100:00100000:1.0:1782480647.656872:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291644800 00000100:00100000:1.0:1782480647.656939:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:1.0:1782480647.656949:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+6:5569:x1869066291644800:12345-192.168.204.51@tcp:40: 00000100:00100000:1.0:1782480647.657664:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+6:5569:x1869066291644800:12345-192.168.204.51@tcp:40: Request processed in 97us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480647.657673:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:1.0:1782480647.663402:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480647.663444:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480647.663475:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480647.663520:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480647.663779:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291644928 00000100:00100000:2.0:1782480647.663788:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291644928 00000100:00100000:2.0:1782480647.663843:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291645056 00000100:00100000:2.0:1782480647.663846:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291645056 00000100:00100000:2.0:1782480647.663858:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:2.0:1782480647.663866:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2365:x1869066291644928:12345-192.168.204.51@tcp:8: 00010000:00080000:2.0:1782480647.663895:0:6604:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:2.0:1782480647.663933:0:6604:0:(genops.c:1406:class_connect()) connect: client 49099535-dcd3-436f-aa96-9770a3f52e5b, cookie 0x3dc3ebf33c0239f0 00002000:00100000:2.0:1782480647.663945:0:6604:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 49099535-dcd3-436f-aa96-9770a3f52e5b/ffff9b6d74c73000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211365f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782480647.663967:0:6604:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1782480647.664496:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291645184 00000100:00100000:3.0:1782480647.664501:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291645184 00000100:00100000:3.0:1782480647.664536:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:3.0:1782480647.664544:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+6:5569:x1869066291645184:12345-192.168.204.51@tcp:33: 00000100:00100000:3.0:1782480647.664635:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291645312 00000100:00100000:3.0:1782480647.664638:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291645312 00000100:00100000:3.0:1782480647.664664:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 125 00000100:00100000:3.0:1782480647.664671:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2369:x1869066291645312:12345-192.168.204.51@tcp:400: 00000100:00100000:3.0:1782480647.664728:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2369:x1869066291645312:12345-192.168.204.51@tcp:400: Request processed in 57us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480647.664735:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 125 00002000:00080000:2.0:1782480647.665385:0:6604:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782480647.665426:0:6604:0:(import.c:65:import_set_state_nolock()) ffff9b6d74c75000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782480647.665461:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2365:x1869066291644928:12345-192.168.204.51@tcp:8: Request processed in 1594us (2015us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480647.665469:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:2.0:1782480647.665488:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:2.0:1782480647.665492:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47378000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2365:x1869066291645056:12345-192.168.204.51@tcp:8: 00010000:00080000:2.0:1782480647.665512:0:6604:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:2.0:1782480647.665531:0:6604:0:(genops.c:1406:class_connect()) connect: client 49099535-dcd3-436f-aa96-9770a3f52e5b, cookie 0x3dc3ebf33c0239f7 00002000:00100000:2.0:1782480647.665539:0:6604:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 49099535-dcd3-436f-aa96-9770a3f52e5b/ffff9b6d74c72000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211365f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782480647.665555:0:6604:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782480647.669301:0:6604:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782480647.669346:0:6604:0:(import.c:65:import_set_state_nolock()) ffff9b6d74c71800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782480647.669422:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47378000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2365:x1869066291645056:12345-192.168.204.51@tcp:8: Request processed in 3926us (5945us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480647.669432:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000004:00080000:3.0:1782480647.725604:0:5810:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 60989us 00000004:00200000:3.0:1782480647.785421:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1782480647.785619:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+6:5569:x1869066291645184:12345-192.168.204.51@tcp:33: Request processed in 121068us (122221us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480647.785633:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00010000:00010000:1.0:1782480647.863051:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480647.929123:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311588352:0@lo:400: 00000100:00100000:1.0:1782480647.929232:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480647.929298:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311588864:0@lo:400: 00000100:00100000:1.0:1782480647.929326:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480647.929349:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782480647.929356:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869066311588480:0@lo:400: 00000100:00100000:1.0:1782480647.929387:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480647.929404:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311588992:0@lo:400: 00000100:00100000:1.0:1782480647.929426:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480647.929461:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311588864 00000100:00100000:1.0:1782480647.929468:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311588864 00000100:00100000:1.0:1782480647.929518:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311588480 00000100:00100000:1.0:1782480647.929521:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311588480 00000100:00100000:1.0:1782480647.929538:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782480647.929546:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311588864:12345-0@lo:400: 00000100:00100000:1.0:1782480647.929599:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311588864:12345-0@lo:400: Request processed in 53us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480647.929620:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782480647.929637:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782480647.929643:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4737bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869066311588480:12345-0@lo:400: 00000100:00100000:1.0:1782480647.929670:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4737bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869066311588480:12345-0@lo:400: Request processed in 28us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480647.929676:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782480647.929693:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311588992 00000100:00100000:1.0:1782480647.929696:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311588992 00000100:00100000:1.0:1782480647.929721:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782480647.929727:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4737a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311588992:12345-0@lo:400: 00000100:00100000:1.0:1782480647.929798:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4737a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311588992:12345-0@lo:400: Request processed in 70us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480647.929805:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1782480647.929822:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782480647.929826:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782480647.929861:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48576680 x1869066311588480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480647.929883:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869066311588480:0@lo:400: 00010000:00080000:1.0:1782480647.929896:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48577480 x1869066311588992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480647.929903:0:3317:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1782480647.929918:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311588992:0@lo:400: 00010000:00080000:1.0:1782480647.929929:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48574380 x1869066311588864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480647.929937:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311588864:0@lo:400: 00000100:00100000:2.0:1782480647.930080:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311588608:0@lo:400: 00000100:00100000:2.0:1782480647.930117:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480647.930151:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782480647.930157:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311588736:0@lo:400: 00000100:00100000:2.0:1782480647.930179:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480647.930209:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311588608 00000100:00100000:2.0:1782480647.930213:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311588608 00000100:00100000:2.0:1782480647.930245:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782480647.930262:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311588608:12345-0@lo:400: 00000100:00100000:2.0:1782480647.930309:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311588608:12345-0@lo:400: Request processed in 50us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480647.930315:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782480647.930333:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311588736 00000100:00100000:2.0:1782480647.930336:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311588736 00000100:00100000:2.0:1782480647.930359:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782480647.930364:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311588736:12345-0@lo:400: 00000100:00100000:2.0:1782480647.930401:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311588736:12345-0@lo:400: Request processed in 36us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480647.930406:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1782480647.930421:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782480647.930424:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782480647.930441:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48576300 x1869066311588736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480647.930450:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311588736:0@lo:400: 00010000:00080000:2.0:1782480647.930459:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48575880 x1869066311588608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480647.930474:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311588608:0@lo:400: 00000100:00100000:3.0:1782480647.930601:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311588352 00000100:00100000:3.0:1782480647.930606:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311588352 00000100:00100000:3.0:1782480647.930638:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1782480647.930645:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3317:x1869066311588352:12345-0@lo:400: 00000100:00100000:3.0:1782480647.930692:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3317:x1869066311588352:12345-0@lo:400: Request processed in 48us (1461us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480647.930699:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1782480647.930842:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311588352:0@lo:400: 00000100:00100000:3.0:1782480648.061039:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480648.062831:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291645440 00000100:00100000:2.0:1782480648.062847:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291645440 00000100:00100000:2.0:1782480648.062938:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:2.0:1782480648.062950:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:5609:x1869066291645440:12345-192.168.204.51@tcp:101: 00010000:00010000:2.0:1782480648.062980:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480648.063057:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c000/0x3dc3ebf33c0239fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f766 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480648.063141:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873dc00/0x3dc3ebf33c023a05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480648.063155:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873dc00/0x3dc3ebf33c023a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480648.063169:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873dc00/0x3dc3ebf33c023a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480648.063366:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1782480648.063370:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480648.063447:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873dc00/0x3dc3ebf33c023a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480648.063475:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c000/0x3dc3ebf33c0239fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f766 expref: 8 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480648.063493:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873dc00/0x3dc3ebf33c023a05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f766 expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480648.063516:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d45d62900) 00010000:00010000:2.0:1782480648.063519:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782480648.063531:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6873dc00, rc 0) 00000100:00100000:2.0:1782480648.063606:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+7:5609:x1869066291645440:12345-192.168.204.51@tcp:101: Request processed in 658us (2576us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480648.063614:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:3.0:1782480648.439092:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782480648.439134:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d47378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311589120:0@lo:13: 00000100:00100000:3.0:1782480648.439209:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480648.439601:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311589120 00000100:00100000:1.0:1782480648.439608:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311589120 00000100:00100000:1.0:1782480648.439657:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782480648.439666:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311589120:12345-0@lo:13: 00002000:00000024:1.0:1782480648.439686:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480648.439730:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311589120:12345-0@lo:13: Request processed in 66us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480648.439737:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1782480648.440006:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d47378a80 x1869066311589120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480648.440023:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d47378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311589120:0@lo:13: 00010000:00010000:0.0:1782480648.887158:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782480649.016066:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 49099535-dcd3-436f-aa96-9770a3f52e5b 00010000:00010000:3.0:1782480649.911028:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480649.977259:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4737aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311589248:0@lo:13: 00000100:00100000:3.0:1782480649.977331:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480649.977484:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311589248 00000100:00100000:1.0:1782480649.977492:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311589248 00000100:00100000:1.0:1782480649.977564:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782480649.977574:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311589248:12345-0@lo:13: 00002000:00000024:1.0:1782480649.977605:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480649.977666:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311589248:12345-0@lo:13: Request processed in 94us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480649.977686:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1782480649.977726:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d4737aa00 x1869066311589248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480665 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480649.977744:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4737aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311589248:0@lo:13: 00000100:00080000:3.0:1782480649.978148:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480650.118806:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480650.118923:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291645568 00000100:00100000:2.0:1782480650.118934:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291645568 00000100:00080000:3.0:1782480650.119020:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480650.119020:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:2.0:1782480650.119033:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4737aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+7:5661:x1869066291645568:12345-192.168.204.51@tcp:41: 00000004:00000024:2.0:1782480650.119091:0:5807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1782480650.119161:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4737aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+7:5661:x1869066291645568:12345-192.168.204.51@tcp:41: Request processed in 132us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480650.119169:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:3.0:1782480650.125371:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480650.126779:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291645696 00000100:00100000:1.0:1782480650.126793:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291645696 00000100:00100000:1.0:1782480650.126931:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:1.0:1782480650.126943:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:49099535-dcd3-436f-aa96-9770a3f52e5b+5:5661:x1869066291645696:12345-192.168.204.51@tcp:13: 00002000:00000024:1.0:1782480650.126970:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480650.127049:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:49099535-dcd3-436f-aa96-9770a3f52e5b+5:5661:x1869066291645696:12345-192.168.204.51@tcp:13: Request processed in 108us (1687us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480650.127056:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00080000:3.0:1782480650.127122:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480650.129810:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480650.130016:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291645824 00000100:00100000:0.0:1782480650.130026:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291645824 00000100:00100000:0.0:1782480650.130098:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:0.0:1782480650.130109:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:49099535-dcd3-436f-aa96-9770a3f52e5b+6:5661:x1869066291645824:12345-192.168.204.51@tcp:13: 00002000:00000024:0.0:1782480650.130149:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480650.130220:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:49099535-dcd3-436f-aa96-9770a3f52e5b+6:5661:x1869066291645824:12345-192.168.204.51@tcp:13: Request processed in 113us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480650.130227:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00080000:3.0:1782480650.130291:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782480650.935882:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480651.961204:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782480652.108621:0:7497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 49099535-dcd3-436f-aa96-9770a3f52e5b 00000001:00100000:0.0:1782480652.110172:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 49099535-dcd3-436f-aa96-9770a3f52e5b 00000100:00100000:2.0:1782480652.900199:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480652.900242:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480652.900282:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480652.900318:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480652.900345:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291646336 00000100:00100000:2.0:1782480652.900354:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291646336 00000100:00100000:2.0:1782480652.900406:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291646208 00000100:00100000:2.0:1782480652.900410:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291646208 00000100:00100000:2.0:1782480652.900430:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:2.0:1782480652.900441:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2368:x1869066291646336:12345-192.168.204.51@tcp:400: 00000100:00100000:2.0:1782480652.900514:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2368:x1869066291646336:12345-192.168.204.51@tcp:400: Request processed in 75us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480652.900523:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:2.0:1782480652.900540:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:2.0:1782480652.900547:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2368:x1869066291646208:12345-192.168.204.51@tcp:400: 00000100:00100000:2.0:1782480652.900588:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2368:x1869066291646208:12345-192.168.204.51@tcp:400: Request processed in 41us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480652.900594:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:1.0:1782480652.900722:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291646080 00000100:00100000:1.0:1782480652.900727:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291646080 00000100:00100000:1.0:1782480652.900804:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:1.0:1782480652.900813:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2368:x1869066291646080:12345-192.168.204.51@tcp:400: 00000100:00100000:1.0:1782480652.900846:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2368:x1869066291646080:12345-192.168.204.51@tcp:400: Request processed in 35us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480652.900854:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:3.0:1782480652.901202:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291645952 00000100:00100000:3.0:1782480652.901207:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291645952 00000100:00100000:3.0:1782480652.901247:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 127 00000100:00100000:3.0:1782480652.901255:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2368:x1869066291645952:12345-192.168.204.51@tcp:400: 00000100:00100000:3.0:1782480652.901284:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2368:x1869066291645952:12345-192.168.204.51@tcp:400: Request processed in 31us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480652.901401:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 127 00000100:00080000:3.0:1782480652.901433:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782480652.901438:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782480652.901441:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782480652.989603:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782480653.007052:0:8149:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1782480653.046982:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311589632:0@lo:400: 00000100:00100000:3.0:1782480653.047069:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480653.047136:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869066311589504:0@lo:400: 00000100:00100000:3.0:1782480653.047144:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480653.047153:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311589760:0@lo:400: 00000100:00100000:0.0:1782480653.047172:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480653.047193:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480653.047215:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311590016:0@lo:400: 00000100:00100000:1.0:1782480653.048803:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311589376:0@lo:400: 00000100:00100000:3.0:1782480653.048985:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311589632 00000100:00100000:3.0:1782480653.048993:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311589632 00000100:00100000:3.0:1782480653.049066:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311589504 00000100:00100000:3.0:1782480653.049070:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311589504 00000100:00100000:3.0:1782480653.049087:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782480653.049095:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311589632:12345-0@lo:400: 00000100:00100000:3.0:1782480653.049174:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311589632:12345-0@lo:400: Request processed in 79us (2104us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480653.049182:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782480653.049200:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782480653.049206:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869066311589504:12345-0@lo:400: 00000100:00100000:3.0:1782480653.049251:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869066311589504:12345-0@lo:400: Request processed in 45us (2079us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480653.049257:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782480653.049276:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311589760 00000100:00100000:3.0:1782480653.049280:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311589760 00000100:00100000:0.0:1782480653.052181:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480653.052369:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869066311589504:0@lo:400: 00000100:00100000:0.0:1782480653.052419:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311590016 00000100:00100000:0.0:1782480653.052426:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311590016 00000100:00100000:3.0:1782480653.052781:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782480653.052792:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311589760:12345-0@lo:400: 00000100:00100000:3.0:1782480653.052856:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311589760:12345-0@lo:400: Request processed in 66us (5664us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480653.052862:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1782480653.052882:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782480653.052887:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782480653.052919:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48576680 x1869066311589760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480653.052930:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311589760:0@lo:400: 00000100:00100000:3.0:1782480653.052944:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311589632:0@lo:400: 00000100:00100000:0.0:1782480653.053165:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782480653.053173:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311590016:12345-0@lo:400: 00000100:00080000:3.0:1782480653.053208:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782480653.053555:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480653.053600:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311589888:0@lo:400: 00000100:00100000:1.0:1782480653.053643:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480653.053682:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311589888 00000100:00100000:1.0:1782480653.053687:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311589888 00000100:00100000:1.0:1782480653.053721:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782480653.053728:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311589888:12345-0@lo:400: 00000100:00100000:1.0:1782480653.053788:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311589888:12345-0@lo:400: Request processed in 60us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480653.053794:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782480653.053825:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311589888:0@lo:400: 00000100:00080000:1.0:1782480653.053839:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480653.053943:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311589376 00000100:00100000:3.0:1782480653.053948:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311589376 00000100:00100000:3.0:1782480653.053986:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1782480653.053993:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3317:x1869066311589376:12345-0@lo:400: 00000100:00100000:3.0:1782480653.054045:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3317:x1869066311589376:12345-0@lo:400: Request processed in 53us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480653.054052:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1782480653.054126:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311589376:0@lo:400: 00000100:00100000:0.0:1782480653.054149:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311590016:12345-0@lo:400: Request processed in 976us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480653.054156:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1782480653.054323:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d473da300 x1869066311590016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480653.054346:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311590016:0@lo:400: 00000100:00100000:2.0:1782480653.559814:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782480653.559841:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d47378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311590144:0@lo:13: 00000100:00100000:2.0:1782480653.559909:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480653.560155:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311590144 00000100:00100000:0.0:1782480653.560164:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311590144 00000100:00100000:0.0:1782480653.560220:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782480653.560229:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311590144:12345-0@lo:13: 00002000:00000024:0.0:1782480653.560266:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480653.560324:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311590144:12345-0@lo:13: Request processed in 96us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480653.560332:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1782480653.560450:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d47378700 x1869066311590144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480653.560468:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d47378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311590144:0@lo:13: 00010000:00010000:2.0:1782480654.015649:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480655.031040:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480655.098039:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480655.098068:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d47379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311590272:0@lo:13: 00000100:00100000:3.0:1782480655.098148:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480655.098474:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311590272 00000100:00100000:0.0:1782480655.098482:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311590272 00000100:00100000:0.0:1782480655.098555:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782480655.098565:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311590272:12345-0@lo:13: 00002000:00000024:0.0:1782480655.098603:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480655.098657:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311590272:12345-0@lo:13: Request processed in 93us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480655.098680:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1782480655.098724:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d47379180 x1869066311590272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480655.098798:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d47379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311590272:0@lo:13: 00000100:00080000:1.0:1782480655.098913:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782480656.055125:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782480656.832937:0:8298:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa658cc60 20000000:00000080:0.0:1782480656.833023:0:8298:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b6d7554f800 uarg=0000000000000000 20000000:01000000:0.0:1782480656.833063:0:8298:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1782480656.833065:0:8298:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1782480656.833069:0:8298:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1782480656.833074:0:8298:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1782480656.833078:0:8298:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1782480656.833094:0:8298:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1782480656.833097:0:8298:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1782480656.833390:0:8298:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1782480656.833393:0:8298:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1782480656.835136:0:8299:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1782480656.836700:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1782480656.836793:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1782480656.836833:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1782480656.836847:0:8298:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1782480656.836849:0:8298:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1782480656.838192:0:8300:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1782480656.841052:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1782480656.841110:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1782480656.841148:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1782480656.841161:0:8298:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1782480656.841164:0:8298:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1782480656.842201:0:8301:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1782480656.843075:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1782480656.843128:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1782480656.843158:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1782480656.843168:0:8298:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782480656.843171:0:8298:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1782480656.844209:0:8302:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1782480656.844611:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1782480656.845003:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1782480656.845060:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:0.0:1782480656.845077:0:8298:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782480656.845095:0:8298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023a0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.845113:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d6873c600/0x3dc3ebf33c023909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023902 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.845121:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d821ed400/0x3dc3ebf33c023933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c02392c expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.845126:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d821ed600/0x3dc3ebf33c02395d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023956 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.845132:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d821ec000/0x3dc3ebf33c02396b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023964 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.845138:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d821eda00/0x3dc3ebf33c023979 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023972 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.845144:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d6873cc00/0x3dc3ebf33c023995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c02398e expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.845151:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d40031800/0x3dc3ebf33c0239bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c0239b8 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.845160:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d821ec200/0x3dc3ebf33c0239cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f704 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.845167:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d6873d800/0x3dc3ebf33c0239d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f70b expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.845182:0:8298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023a0c lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.845223:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d6873d800/0x3dc3ebf33c0239d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f70b expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.845240:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d6873d800/0x3dc3ebf33c0239d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f70b expref: 9 pid: 5799 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480656.845257:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869066311590400:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480656.845476:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d821ec200/0x3dc3ebf33c0239cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f704 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.845484:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d821ec200/0x3dc3ebf33c0239cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f704 expref: 9 pid: 5802 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480656.845492:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48576300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869066311590528:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480656.845517:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d40031800/0x3dc3ebf33c0239bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c0239b8 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.845524:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d40031800/0x3dc3ebf33c0239bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c0239b8 expref: 18 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480656.845534:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869066311590656:0@lo:104: 00000100:00100000:0.0:1782480656.845573:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782480656.845670:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d6873cc00/0x3dc3ebf33c023995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c02398e expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.845689:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d6873cc00/0x3dc3ebf33c023995 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c02398e expref: 18 pid: 5801 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480656.845698:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48576680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869066311590784:0@lo:104: 00000100:00100000:0.0:1782480656.845735:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782480656.847207:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d821eda00/0x3dc3ebf33c023979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c023972 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.847222:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d821eda00/0x3dc3ebf33c023979 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c023972 expref: 18 pid: 5801 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480656.847233:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869066311590912:0@lo:104: 00010000:00010000:0.0:1782480656.847271:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d821ec000/0x3dc3ebf33c02396b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c023964 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.847279:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d821ec000/0x3dc3ebf33c02396b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c023964 expref: 18 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480656.847286:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869066311591040:0@lo:104: 00010000:00010000:0.0:1782480656.847311:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d821ed600/0x3dc3ebf33c02395d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c023956 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.847330:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d821ed600/0x3dc3ebf33c02395d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c023956 expref: 18 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480656.847339:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48573100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869066311591168:0@lo:104: 00010000:00010000:0.0:1782480656.847365:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d821ed400/0x3dc3ebf33c023933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c02392c expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.847389:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d821ed400/0x3dc3ebf33c023933 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c02392c expref: 18 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480656.847397:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48572d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869066311591296:0@lo:104: 00010000:00010000:0.0:1782480656.847436:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d6873c600/0x3dc3ebf33c023909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c023902 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.847444:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d6873c600/0x3dc3ebf33c023909 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c023902 expref: 18 pid: 5799 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480656.847452:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869066311591424:0@lo:104: 00000100:00100000:0.0:1782480656.847471:0:8298:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae5d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480656.848494:0:5790:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782480656.848524:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480656.848544:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480656.848551:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480656.848559:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480656.848565:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480656.848573:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311590656 00000100:00100000:3.0:1782480656.848580:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311590656 00000100:00100000:3.0:1782480656.848616:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311590784 00000100:00100000:3.0:1782480656.848619:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311590784 00000100:00100000:3.0:1782480656.848626:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311590912 00000100:00100000:3.0:1782480656.848628:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311590912 00000100:00100000:3.0:1782480656.848635:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311591040 00000100:00100000:3.0:1782480656.848637:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311591040 00000100:00100000:3.0:1782480656.848861:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311591168 00000100:00100000:3.0:1782480656.848864:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311591168 00000100:00100000:3.0:1782480656.848874:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311591296 00000100:00100000:3.0:1782480656.848876:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311591296 00000100:00100000:3.0:1782480656.848883:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311591424 00000100:00100000:3.0:1782480656.848884:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311591424 00000100:00100000:3.0:1782480656.848895:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782480656.848902:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48577480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+9:8298:x1869066311590656:12345-0@lo:104: 00010000:00010000:3.0:1782480656.848916:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d821ece00/0x3dc3ebf33c0239b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c0239bf expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480656.849019:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782480656.849025:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48577480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+9:8298:x1869066311590656:12345-0@lo:104: Request processed in 124us (3453us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480656.849033:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782480656.849049:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782480656.849068:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7554dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+8:8298:x1869066311590784:12345-0@lo:104: 00010000:00010000:3.0:1782480656.849076:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c800/0x3dc3ebf33c02398e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023995 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480656.849115:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782480656.849119:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7554dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+8:8298:x1869066311590784:12345-0@lo:104: Request processed in 65us (3385us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480656.849124:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782480656.849156:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782480656.849161:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+7:8298:x1869066311590912:12345-0@lo:104: 00010000:00010000:3.0:1782480656.849167:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023979 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480656.849197:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782480656.849202:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+7:8298:x1869066311590912:12345-0@lo:104: Request processed in 41us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480656.849207:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782480656.849218:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782480656.849223:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+6:8298:x1869066311591040:12345-0@lo:104: 00010000:00010000:3.0:1782480656.849229:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c200/0x3dc3ebf33c023964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c02396b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480656.849261:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1782480656.849265:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+6:8298:x1869066311591040:12345-0@lo:104: Request processed in 43us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480656.849270:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782480656.849281:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782480656.849286:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+5:8298:x1869066311591168:12345-0@lo:104: 00010000:00010000:3.0:1782480656.849293:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d000/0x3dc3ebf33c023956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c02395d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480656.849422:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:2.0:1782480656.849429:0:5791:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1782480656.849437:0:5791:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1782480656.849460:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1782480656.849467:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d821ece00/0x3dc3ebf33c0239b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c0239bf expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.849475:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ece00 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:2.0:1782480656.849479:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821ece00/0x3dc3ebf33c0239b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c0239bf expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.849489:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d821ece00/0x3dc3ebf33c0239b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c0239bf expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480656.849509:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821ece00/0x3dc3ebf33c0239b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c0239bf expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480656.849514:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782480656.849548:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d821ece00/0x3dc3ebf33c0239b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c0239bf expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.849554:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782480656.849573:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d821ece00/0x3dc3ebf33c0239b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c0239bf expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.849580:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d821ece00/0x3dc3ebf33c0239b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c0239bf expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.849595:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782480656.849598:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c800/0x3dc3ebf33c02398e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023995 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.849603:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6873c800 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:2.0:1782480656.849605:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c800/0x3dc3ebf33c02398e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c023995 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.849610:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c800/0x3dc3ebf33c02398e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c023995 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480656.849616:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c800/0x3dc3ebf33c02398e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c023995 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480656.849620:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782480656.849652:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c800/0x3dc3ebf33c02398e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023995 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.849659:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782480656.849666:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c800/0x3dc3ebf33c02398e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023995 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.849671:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c800/0x3dc3ebf33c02398e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023995 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.849680:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782480656.849682:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023979 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.849688:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ec400 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:2.0:1782480656.849691:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c023979 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.849697:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c023979 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480656.849919:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c023979 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480656.849924:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782480656.849943:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023972 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023979 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.849962:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782480656.849979:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023972 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023979 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.849995:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023972 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023979 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.850005:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480656.850008:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c200/0x3dc3ebf33c023964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c02396b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.850013:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6873c200 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:2.0:1782480656.850016:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c200/0x3dc3ebf33c023964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c02396b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.850022:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c200/0x3dc3ebf33c023964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c02396b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480656.850027:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c200/0x3dc3ebf33c023964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c02396b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480656.850032:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782480656.850059:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c200/0x3dc3ebf33c023964 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c02396b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.850065:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782480656.850070:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c200/0x3dc3ebf33c023964 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c02396b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.850075:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c200/0x3dc3ebf33c023964 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c02396b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.850083:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480656.850089:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480656.850091:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480656.850118:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311591552:0@lo:103: 00000100:00100000:2.0:1782480656.850159:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480656.850195:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782480656.850202:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311591680:0@lo:103: 00000100:00100000:2.0:1782480656.850223:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480656.850257:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311591808:0@lo:103: 00000100:00100000:2.0:1782480656.850279:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480656.850294:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782480656.850299:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311591936:0@lo:103: 00000100:00100000:2.0:1782480656.850316:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782480656.850788:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782480656.850796:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+5:8298:x1869066311591168:12345-0@lo:104: Request processed in 1509us (2243us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480656.850804:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782480656.850826:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782480656.850836:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+4:8298:x1869066311591296:12345-0@lo:104: 00010000:00010000:3.0:1782480656.850846:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c02392c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023933 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480656.850887:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782480656.850892:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+4:8298:x1869066311591296:12345-0@lo:104: Request processed in 61us (2332us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480656.850897:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782480656.850907:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782480656.850912:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+3:8298:x1869066311591424:12345-0@lo:104: 00010000:00010000:3.0:1782480656.850920:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c023902 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023909 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480656.850966:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782480656.850971:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+3:8298:x1869066311591424:12345-0@lo:104: Request processed in 59us (2404us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480656.850975:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1782480656.850990:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782480656.850994:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d000/0x3dc3ebf33c023956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c02395d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480656.851000:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6873d000 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:3.0:1782480656.851003:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d000/0x3dc3ebf33c023956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c02395d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480656.851010:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d000/0x3dc3ebf33c023956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c02395d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480656.851016:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d000/0x3dc3ebf33c023956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c02395d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480656.851022:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782480656.851044:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d000/0x3dc3ebf33c023956 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c02395d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480656.851050:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480656.851063:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d000/0x3dc3ebf33c023956 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c02395d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480656.851070:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d000/0x3dc3ebf33c023956 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c02395d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480656.851089:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782480656.851092:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c02392c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023933 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480656.851097:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d82164800 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:3.0:1782480656.851099:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c02392c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c023933 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480656.851105:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c02392c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c023933 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480656.851110:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c02392c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c023933 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480656.851114:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782480656.851127:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c02392c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023933 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480656.851132:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480656.851136:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c02392c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023933 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480656.851142:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c02392c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023933 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480656.851152:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480656.851155:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c023902 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023909 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480656.851169:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ecc00 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:3.0:1782480656.851173:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c023902 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c023909 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480656.851180:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c023902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c023909 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480656.851185:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c023902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c023909 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480656.851190:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782480656.851201:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c023902 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023909 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480656.851206:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480656.851211:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c023902 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023909 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480656.851216:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d821ecc00/0x3dc3ebf33c023902 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023909 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480656.851228:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480656.851229:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480656.851231:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480656.851239:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480656.851382:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311592320:0@lo:103: 00000100:00100000:2.0:1782480656.851409:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480656.851435:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311591552 00000100:00100000:2.0:1782480656.851441:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311591552 00010000:00010000:2.0:1782480656.851467:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d40031800/0x3dc3ebf33c0239bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c0239b8 expref: 19 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480656.851482:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311591680 00000100:00100000:2.0:1782480656.851484:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311591680 00010000:00010000:2.0:1782480656.851493:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d6873cc00/0x3dc3ebf33c023995 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c02398e expref: 20 pid: 5801 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480656.851501:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311591808 00000100:00100000:2.0:1782480656.851503:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311591808 00010000:00010000:2.0:1782480656.851512:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d821eda00/0x3dc3ebf33c023979 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023972 expref: 21 pid: 5801 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480656.851519:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311591936 00000100:00100000:2.0:1782480656.851527:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311591936 00010000:00010000:2.0:1782480656.851538:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d821ec000/0x3dc3ebf33c02396b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023964 expref: 22 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480656.851547:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311592320 00000100:00100000:2.0:1782480656.851549:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311592320 00010000:00010000:2.0:1782480656.851556:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d6873c600/0x3dc3ebf33c023909 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023902 expref: 23 pid: 5799 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480656.851565:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782480656.851570:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b332300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+23:3317:x1869066311591552:12345-0@lo:103: 00010000:00010000:2.0:1782480656.851582:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480656.851587:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d40031800/0x3dc3ebf33c0239bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c0239b8 expref: 23 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.851596:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d40031800/0x3dc3ebf33c0239bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c0239b8 expref: 23 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.851613:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480656.851634:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b332300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+23:3317:x1869066311591552:12345-0@lo:103: Request processed in 64us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480656.851639:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1782480656.851766:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40031800/0x3dc3ebf33c0239bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c0239b8 expref: 23 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480656.851778:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869066311590656:0@lo:104: 00000100:00100000:0.0:1782480656.851794:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48576680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869066311590784:0@lo:104: 00000100:00100000:0.0:1782480656.851803:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869066311590912:0@lo:104: 00000100:00100000:0.0:1782480656.851810:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869066311591040:0@lo:104: 00000100:00100000:0.0:1782480656.851819:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48573100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869066311591168:0@lo:104: 00000100:00100000:0.0:1782480656.851826:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48572d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869066311591296:0@lo:104: 00000100:00100000:0.0:1782480656.851834:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869066311591424:0@lo:104: 00000100:00100000:1.0:1782480656.852276:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480656.852414:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869066311590400:192.168.204.51@tcp:104: 00000100:00100000:0.0:1782480656.852422:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48576300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869066311590528:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480656.852461:0:8298:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023a0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480656.852533:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291646592 00000100:00100000:2.0:1782480656.852537:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291646592 00010000:00010000:2.0:1782480656.852555:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d821ec200/0x3dc3ebf33c0239cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f704 expref: 10 pid: 5802 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480656.852568:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782480656.852574:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b330a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+21:3317:x1869066311591680:12345-0@lo:103: 00010000:00010000:2.0:1782480656.852583:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480656.852594:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d6873cc00/0x3dc3ebf33c023995 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c02398e expref: 21 pid: 5801 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.852602:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d6873cc00/0x3dc3ebf33c023995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c02398e expref: 21 pid: 5801 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.852613:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d6873cc00/0x3dc3ebf33c023995 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c02398e expref: 21 pid: 5801 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.852623:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480656.852818:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480656.852828:0:5793:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1782480656.852836:0:5793:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1782480656.852846:0:5792:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1782480656.852855:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782480656.852861:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b332a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+20:3315:x1869066311591808:12345-0@lo:103: 00010000:00010000:0.0:1782480656.852869:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480656.852875:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d821eda00/0x3dc3ebf33c023979 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023972 expref: 20 pid: 5801 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.852883:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d821eda00/0x3dc3ebf33c023979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c023972 expref: 20 pid: 5801 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.852892:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d821eda00/0x3dc3ebf33c023979 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c023972 expref: 20 pid: 5801 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.852900:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480656.852940:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b332a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311591808:12345-0@lo:103: Request processed in 79us (2660us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480656.852947:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782480656.852972:0:5792:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1782480656.852978:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782480656.852983:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b330380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+18:3315:x1869066311591936:12345-0@lo:103: 00010000:00010000:0.0:1782480656.852992:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480656.852996:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d821ec000/0x3dc3ebf33c02396b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023964 expref: 18 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.853004:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d821ec000/0x3dc3ebf33c02396b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c023964 expref: 18 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.853020:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d821ec000/0x3dc3ebf33c02396b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c023964 expref: 18 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.853028:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480656.853050:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b330380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+17:3315:x1869066311591936:12345-0@lo:103: Request processed in 67us (2733us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480656.853056:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782480656.853067:0:5792:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1782480656.853072:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782480656.853077:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b330700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+16:3315:x1869066311592320:12345-0@lo:103: 00010000:00010000:0.0:1782480656.853084:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480656.853087:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d6873c600/0x3dc3ebf33c023909 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023902 expref: 16 pid: 5799 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.853094:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d6873c600/0x3dc3ebf33c023909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c023902 expref: 16 pid: 5799 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.853103:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d6873c600/0x3dc3ebf33c023909 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c023902 expref: 16 pid: 5799 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.853111:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480656.853132:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b330700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+15:3315:x1869066311592320:12345-0@lo:103: Request processed in 55us (1723us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480656.853137:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782480656.853147:0:5792:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1782480656.853154:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:0.0:1782480656.853160:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4737b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2368:x1869066291646592:12345-192.168.204.51@tcp:103: 00010000:00010000:0.0:1782480656.853169:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480656.853179:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d821ec200/0x3dc3ebf33c0239cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f704 expref: 10 pid: 5802 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.853186:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d821ec200/0x3dc3ebf33c0239cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f704 expref: 10 pid: 5802 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.853197:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d821ec200/0x3dc3ebf33c0239cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f704 expref: 10 pid: 5802 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.853205:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480656.853547:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311592320:0@lo:103: 00000100:00100000:3.0:1782480656.853556:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311591936:0@lo:103: 00000100:00100000:3.0:1782480656.853563:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311591808:0@lo:103: 00000100:00100000:0.0:1782480656.853778:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4737b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+9:2368:x1869066291646592:12345-192.168.204.51@tcp:103: Request processed in 480us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480656.853787:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:2.0:1782480656.854064:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b330a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+14:3317:x1869066311591680:12345-0@lo:103: Request processed in 1489us (3838us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480656.854071:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782480656.854106:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311592064:0@lo:103: 00000100:00100000:2.0:1782480656.854143:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480656.854184:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311591680:0@lo:103: 00000100:00100000:2.0:1782480656.854192:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311591552:0@lo:103: 00000100:00100000:2.0:1782480656.854204:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782480656.854208:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311592192:0@lo:103: 00000100:00100000:0.0:1782480656.854625:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311592064 00000100:00100000:0.0:1782480656.854632:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311592064 00010000:00010000:0.0:1782480656.854819:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d821ed600/0x3dc3ebf33c02395d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023956 expref: 14 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480656.854853:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782480656.854860:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d465fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+14:3317:x1869066311592064:12345-0@lo:103: 00010000:00010000:0.0:1782480656.854872:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480656.854876:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d821ed600/0x3dc3ebf33c02395d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023956 expref: 14 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.854884:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d821ed600/0x3dc3ebf33c02395d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c023956 expref: 14 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.854897:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d821ed600/0x3dc3ebf33c02395d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c023956 expref: 14 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480656.854908:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480656.854943:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d465fec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+13:3317:x1869066311592064:12345-0@lo:103: Request processed in 84us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480656.854960:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782480656.855175:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480656.855210:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311592064:0@lo:103: 00000100:00100000:1.0:1782480656.855297:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311592192 00000100:00100000:1.0:1782480656.855301:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311592192 00010000:00010000:1.0:1782480656.855449:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d821ed400/0x3dc3ebf33c023933 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c02392c expref: 13 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480656.855467:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782480656.855474:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b331180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+13:3317:x1869066311592192:12345-0@lo:103: 00010000:00010000:1.0:1782480656.855482:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480656.855486:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d821ed400/0x3dc3ebf33c023933 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c02392c expref: 13 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480656.855494:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d821ed400/0x3dc3ebf33c023933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c02392c expref: 13 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480656.855503:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d821ed400/0x3dc3ebf33c023933 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c02392c expref: 13 pid: 5802 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480656.855518:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480656.855546:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b331180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+12:3317:x1869066311592192:12345-0@lo:103: Request processed in 73us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480656.855552:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782480656.855640:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311592192:0@lo:103: 00000100:00100000:2.0:1782480656.865864:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480656.865930:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291646464 00000100:00100000:1.0:1782480656.865940:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291646464 00010000:00010000:1.0:1782480656.865996:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d6873d800/0x3dc3ebf33c0239d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f70b expref: 9 pid: 5799 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480656.866035:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:1.0:1782480656.866045:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b333800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+9:2367:x1869066291646464:12345-192.168.204.51@tcp:103: 00010000:00010000:1.0:1782480656.866060:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480656.866066:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d6873d800/0x3dc3ebf33c0239d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f70b expref: 9 pid: 5799 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480656.866078:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d6873d800/0x3dc3ebf33c0239d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f70b expref: 9 pid: 5799 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480656.866096:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d6873d800/0x3dc3ebf33c0239d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f70b expref: 9 pid: 5799 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480656.866112:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023a0c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480656.866120:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023a0c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480656.866137:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023a0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480656.866157:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023a0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480656.866163:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023a0c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480656.866170:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023a0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480656.866176:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40031200 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480656.866181:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023a0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480656.866189:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023a0c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480656.866214:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023a0c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480656.866225:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782480656.866347:0:8298:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023a0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.866357:0:8298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023a0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480656.866374:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40031200/0x3dc3ebf33c023a0c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480656.866384:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b333800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+8:2367:x1869066291646464:12345-192.168.204.51@tcp:103: Request processed in 339us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480656.866393:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00010000:00010000:3.0:1782480657.080364:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480658.008790:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480658.008853:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480658.008888:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480658.008919:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480658.008965:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291647104 00000100:00100000:1.0:1782480658.009057:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291646976 00000100:00100000:1.0:1782480658.009067:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291646976 00000100:00100000:1.0:1782480658.009143:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:1.0:1782480658.009155:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2368:x1869066291646976:12345-192.168.204.51@tcp:400: 00000100:00100000:1.0:1782480658.009233:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2368:x1869066291646976:12345-192.168.204.51@tcp:400: Request processed in 81us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480658.009257:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00080000:1.0:1782480658.009278:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480658.009523:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291647104 00000100:00100000:3.0:1782480658.009569:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:3.0:1782480658.009578:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2369:x1869066291647104:12345-192.168.204.51@tcp:400: 00000100:00100000:3.0:1782480658.009608:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2369:x1869066291647104:12345-192.168.204.51@tcp:400: Request processed in 32us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480658.009614:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:2.0:1782480658.009698:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291646848 00000100:00100000:2.0:1782480658.009703:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291646848 00000100:00100000:2.0:1782480658.009741:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:2.0:1782480658.009776:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2369:x1869066291646848:12345-192.168.204.51@tcp:400: 00000100:00100000:2.0:1782480658.009803:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2369:x1869066291646848:12345-192.168.204.51@tcp:400: Request processed in 57us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480658.009809:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00080000:1.0:1782480658.011604:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782480658.011615:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782480658.011687:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291646720 00000100:00100000:0.0:1782480658.011697:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291646720 00000100:00100000:0.0:1782480658.011785:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 129 00000100:00100000:0.0:1782480658.011794:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+8:2368:x1869066291646720:12345-192.168.204.51@tcp:400: 00000100:00100000:0.0:1782480658.011869:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+8:2368:x1869066291646720:12345-192.168.204.51@tcp:400: Request processed in 77us (3016us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480658.011877:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 129 00010000:00010000:3.0:1782480658.103025:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480658.167107:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869066311592576:0@lo:400: 00000100:00100000:1.0:1782480658.167178:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480658.167245:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311593088:0@lo:400: 00000100:00100000:1.0:1782480658.167272:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480658.167304:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782480658.167311:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311592704:0@lo:400: 00000100:00100000:1.0:1782480658.167335:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480658.167377:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311593088 00000100:00100000:1.0:1782480658.167384:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311593088 00000100:00100000:1.0:1782480658.167439:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782480658.167448:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47379180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311593088:12345-0@lo:400: 00000100:00100000:1.0:1782480658.167498:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47379180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311593088:12345-0@lo:400: Request processed in 50us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480658.167505:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1782480658.167523:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782480658.167546:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d4981ed80 x1869066311593088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480658.167560:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311593088:0@lo:400: 00000100:00100000:3.0:1782480658.167830:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311592832:0@lo:400: 00000100:00100000:3.0:1782480658.167861:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480658.167893:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782480658.167900:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311592448:0@lo:400: 00000100:00100000:3.0:1782480658.167940:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480658.167964:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311592960:0@lo:400: 00000100:00100000:3.0:1782480658.168410:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480658.168440:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311592448 00000100:00100000:3.0:1782480658.168444:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311592448 00000100:00100000:3.0:1782480658.168473:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1782480658.168479:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:3315:x1869066311592448:12345-0@lo:400: 00000100:00100000:3.0:1782480658.168517:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+12:3315:x1869066311592448:12345-0@lo:400: Request processed in 37us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480658.168537:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1782480658.168570:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311592576 00000100:00100000:3.0:1782480658.168574:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311592576 00000100:00100000:3.0:1782480658.168593:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311592704 00000100:00100000:3.0:1782480658.168596:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311592704 00000100:00100000:0.0:1782480658.168791:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311592960 00000100:00100000:0.0:1782480658.168796:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311592960 00000100:00100000:0.0:1782480658.168827:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782480658.168834:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4737b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869066311592576:12345-0@lo:400: 00000100:00100000:0.0:1782480658.168873:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4737b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869066311592576:12345-0@lo:400: Request processed in 39us (1696us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480658.168879:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782480658.168891:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782480658.168897:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311592960:12345-0@lo:400: 00000100:00100000:0.0:1782480658.168937:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311592960:12345-0@lo:400: Request processed in 28us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480658.168943:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782480658.168961:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311592832 00000100:00100000:0.0:1782480658.168965:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311592832 00000100:00100000:0.0:1782480658.168987:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782480658.168993:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311592832:12345-0@lo:400: 00000100:00100000:0.0:1782480658.169027:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311592832:12345-0@lo:400: Request processed in 34us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480658.169040:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782480658.169079:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311592448:0@lo:400: 00000100:00100000:0.0:1782480658.169101:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311592960:0@lo:400: 00010000:00080000:0.0:1782480658.169113:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d4981f480 x1869066311592832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782480658.169120:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480658.169122:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311592832:0@lo:400: 00000100:00080000:1.0:1782480658.169124:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480658.169162:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869066311592576:0@lo:400: 00000100:00100000:3.0:1782480658.169269:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782480658.169275:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311592704:12345-0@lo:400: 00000100:00100000:3.0:1782480658.169329:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311592704:12345-0@lo:400: Request processed in 54us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480658.169335:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1782480658.169483:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480658.169787:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311592704:0@lo:400: 00000100:00100000:0.0:1782480658.680505:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480658.680532:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d47378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311593216:0@lo:13: 00000100:00100000:0.0:1782480658.680604:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480658.680766:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311593216 00000100:00100000:1.0:1782480658.680786:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311593216 00000100:00100000:1.0:1782480658.680989:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782480658.680999:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311593216:12345-0@lo:13: 00002000:00000024:1.0:1782480658.681036:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480658.681783:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311593216:12345-0@lo:13: Request processed in 783us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480658.681792:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1782480658.686346:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d47378a80 x1869066311593216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480658.686382:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d47378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311593216:0@lo:13: 10000000:01000000:2.0:1782480658.806927:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782480658.806937:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9b6d7581c000 from 39 10000000:01000000:2.0:1782480658.806943:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782480658.806996:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d200/0x3dc3ebf33c023a13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480658.807008:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d200/0x3dc3ebf33c023a13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480658.807019:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d200/0x3dc3ebf33c023a13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480658.807043:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b333100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311593344:0@lo:101: 00000100:00100000:2.0:1782480658.807115:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480658.807196:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f250900 going to sleep for 11 seconds 00000100:00100000:3.0:1782480658.807403:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311593344 00000100:00100000:3.0:1782480658.807412:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311593344 00000100:00100000:3.0:1782480658.807482:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1782480658.807492:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+12:5804:x1869066311593344:12345-0@lo:101: 00010000:00010000:3.0:1782480658.807506:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480658.807520:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023a1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023a13 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480658.807543:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023a13 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480658.807554:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023a1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023a13 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480658.807564:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d413f5c00, rc 0) 00000100:00100000:3.0:1782480658.807617:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+13:5804:x1869066311593344:12345-0@lo:101: Request processed in 126us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480658.807624:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1782480658.807842:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b333100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311593344:0@lo:101: 00010000:00010000:2.0:1782480658.807862:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d200/0x3dc3ebf33c023a13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480658.807870:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d200/0x3dc3ebf33c023a13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023a1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480658.807932:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b333100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311593472:0@lo:501: 00000100:00100000:2.0:1782480658.807960:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480658.807987:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f250900 going to sleep for 11 seconds 00000100:00100000:0.0:1782480658.808106:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311593472 00000100:00100000:0.0:1782480658.808112:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311593472 00000100:00100000:0.0:1782480658.808149:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1782480658.808157:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+13:5804:x1869066311593472:12345-0@lo:501: 00000100:00100000:0.0:1782480658.808436:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+13:5804:x1869066311593472:12345-0@lo:501: Request processed in 278us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480658.808443:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1782480658.808526:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b333100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311593472:0@lo:501: 00000100:00100000:2.0:1782480658.808558:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b333100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311593600:0@lo:503: 00000100:00100000:2.0:1782480658.808598:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480658.808622:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f250900 going to sleep for 11 seconds 00000100:00100000:1.0:1782480658.808689:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311593600 00000100:00100000:1.0:1782480658.808694:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311593600 00000100:00100000:1.0:1782480658.808728:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1782480658.808736:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+13:5804:x1869066311593600:12345-0@lo:503: 00000100:00100000:1.0:1782480658.808928:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+13:5804:x1869066311593600:12345-0@lo:503: Request processed in 193us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480658.808935:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1782480658.809062:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b333100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311593600:0@lo:503: 00000100:00100000:0.0:1782480658.813924:0:8317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8317:1869066311593728:0@lo:502: 00000100:00100000:0.0:1782480658.814022:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480658.814085:0:8317:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae5d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480658.814213:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311593728 00000100:00100000:1.0:1782480658.814221:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311593728 00000100:00100000:1.0:1782480658.814269:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1782480658.814280:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+13:8317:x1869066311593728:12345-0@lo:502: 00000100:00100000:1.0:1782480658.814572:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+13:8317:x1869066311593728:12345-0@lo:502: Request processed in 293us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480658.814581:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1782480658.815020:0:8317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8317:1869066311593728:0@lo:502: 00000100:00100000:2.0:1782480658.815079:0:8317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b333100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8317:1869066311593856:0@lo:502: 00000100:00100000:2.0:1782480658.815122:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480658.815158:0:8317:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f250900 going to sleep for 11 seconds 00000100:00100000:3.0:1782480658.815226:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311593856 00000100:00100000:3.0:1782480658.815231:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311593856 00000100:00100000:3.0:1782480658.815272:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1782480658.815280:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+13:8317:x1869066311593856:12345-0@lo:502: 00000100:00100000:3.0:1782480658.815457:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+13:8317:x1869066311593856:12345-0@lo:502: Request processed in 178us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480658.815463:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1782480658.815628:0:8317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b333100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8317:1869066311593856:0@lo:502: 00000040:00080000:2.0:1782480658.815649:0:8317:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1782480658.815922:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1782480658.815940:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782480658.815950:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d200/0x3dc3ebf33c023a13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480658.815962:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d200/0x3dc3ebf33c023a13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480658.815971:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1782480658.815974:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1782480658.815976:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782480658.816003:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c023a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480658.816010:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c023a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480658.816019:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c023a21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480658.816032:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311593984:0@lo:101: 00000100:00100000:3.0:1782480658.816065:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480658.816094:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d4659fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1782480658.816208:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311593984 00000100:00100000:2.0:1782480658.816213:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311593984 00000100:00100000:2.0:1782480658.816249:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1782480658.816257:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d59946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+13:5804:x1869066311593984:12345-0@lo:101: 00010000:00010000:2.0:1782480658.816267:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480658.816287:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d6873de00/0x3dc3ebf33c023a28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023a21 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480658.816310:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d6873de00/0x3dc3ebf33c023a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023a21 expref: 14 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480658.816321:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d6873de00/0x3dc3ebf33c023a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023a21 expref: 14 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480658.816330:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6873de00, rc 0) 00000100:00100000:2.0:1782480658.816368:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d59946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+14:5804:x1869066311593984:12345-0@lo:101: Request processed in 112us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480658.816374:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1782480658.816484:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311593984:0@lo:101: 00010000:00010000:3.0:1782480658.816496:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c023a21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a28 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480658.816507:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c023a21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023a28 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480658.816555:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311594112:0@lo:501: 00000100:00100000:3.0:1782480658.816582:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480658.816657:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d4659fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782480658.827261:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311594112 00000100:00100000:1.0:1782480658.827277:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311594112 00000100:00100000:1.0:1782480658.827780:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1782480658.827793:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d5a19c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+14:5804:x1869066311594112:12345-0@lo:501: 00000100:00100000:1.0:1782480658.828203:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d5a19c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+14:5804:x1869066311594112:12345-0@lo:501: Request processed in 411us (11618us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480658.828220:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1782480658.843097:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311594112:0@lo:501: 00000100:00100000:3.0:1782480658.843165:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311594240:0@lo:503: 00000100:00100000:3.0:1782480658.843242:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480658.843281:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d4659fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782480658.844873:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311594240 00000100:00100000:1.0:1782480658.844895:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311594240 00000100:00100000:1.0:1782480658.844972:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1782480658.844982:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+14:5804:x1869066311594240:12345-0@lo:503: 00000100:00100000:1.0:1782480658.845230:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+14:5804:x1869066311594240:12345-0@lo:503: Request processed in 249us (1987us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480658.845238:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1782480658.845890:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311594240:0@lo:503: 00000100:00100000:3.0:1782480658.847173:0:8318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8318:1869066311594368:0@lo:502: 00000100:00100000:3.0:1782480658.847244:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480658.847289:0:8318:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d4659f300 going to sleep for 11 seconds 00000100:00100000:1.0:1782480658.847631:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311594368 00000100:00100000:1.0:1782480658.847638:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311594368 00000100:00100000:1.0:1782480658.847693:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1782480658.847702:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+14:8318:x1869066311594368:12345-0@lo:502: 00000100:00100000:1.0:1782480658.847963:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+14:8318:x1869066311594368:12345-0@lo:502: Request processed in 261us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480658.847970:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1782480658.848282:0:8318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8318:1869066311594368:0@lo:502: 00000020:01000000:3.0:1782480658.848311:0:8318:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782480658.848320:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480658.848323:0:8318:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1782480658.848327:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782480658.848353:0:8318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8318:1869066311594496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480658.848389:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480658.848420:0:8318:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d4659f300 going to sleep for 11 seconds 00000100:00100000:2.0:1782480658.848470:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311594496 00000100:00100000:2.0:1782480658.848475:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311594496 00000100:00100000:2.0:1782480658.848499:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1782480658.848505:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+14:8318:x1869066311594496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480658.848655:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+14:8318:x1869066311594496:12345-0@lo:502:llog_process_th.0 Request processed in 149us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480658.848661:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1782480658.849003:0:8318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8318:1869066311594496:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782480658.849025:0:8318:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782480658.849031:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480658.849033:0:8318:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782480658.849037:0:8318:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1782480658.849280:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1782480658.849300:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1782480658.849312:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c023a21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a28 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480658.849323:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c023a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a28 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480658.849335:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782480658.849344:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9b6d46055800 from 39 10000000:01000000:2.0:1782480658.849347:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782480658.849374:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d400/0x3dc3ebf33c023a2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480658.849382:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d400/0x3dc3ebf33c023a2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480658.849391:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d400/0x3dc3ebf33c023a2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480658.849408:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b333100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311594624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782480658.849443:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480658.849477:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f2503c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480658.849983:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311594624 00000100:00100000:1.0:1782480658.849991:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311594624 00000100:00100000:1.0:1782480658.850033:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1782480658.850042:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+14:5804:x1869066311594624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480658.850054:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480658.850243:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c023a36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023a2f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480658.850270:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c023a36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023a2f expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480658.850280:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c023a36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023a2f expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480658.850297:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d82165a00, rc 0) 00000100:00100000:1.0:1782480658.850350:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+15:5804:x1869066311594624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 309us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480658.850356:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1782480658.850437:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b333100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311594624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480658.850454:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d400/0x3dc3ebf33c023a2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a36 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480658.850462:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d400/0x3dc3ebf33c023a2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023a36 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480658.850518:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b333100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311594752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480658.850546:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480658.850583:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f2503c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480658.850818:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311594752 00000100:00100000:1.0:1782480658.850823:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311594752 00000100:00100000:1.0:1782480658.850895:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1782480658.850903:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+15:5804:x1869066311594752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480658.851162:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+15:5804:x1869066311594752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480658.851170:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1782480658.851248:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b333100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311594752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480658.851280:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311594880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782480658.851318:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480658.870772:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d4659f300 going to sleep for 11 seconds 00000100:00100000:2.0:1782480658.878792:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311594880 00000100:00100000:2.0:1782480658.878807:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311594880 00000100:00100000:2.0:1782480658.878873:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1782480658.878895:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+15:5804:x1869066311594880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480658.879376:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+15:5804:x1869066311594880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 492us (28055us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480658.879391:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1782480658.879534:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311594880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782480658.880135:0:8319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8319:1869066311595008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480658.880180:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480658.880217:0:8319:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d4659fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782480658.880324:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311595008 00000100:00100000:1.0:1782480658.880331:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311595008 00000100:00100000:1.0:1782480658.880371:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1782480658.880380:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+15:8319:x1869066311595008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480658.880573:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+15:8319:x1869066311595008:12345-0@lo:502:llog_process_th.0 Request processed in 193us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480658.880580:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1782480658.880665:0:8319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8319:1869066311595008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480658.880718:0:8319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8319:1869066311595136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480658.880777:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480658.880790:0:8319:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49e853c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480658.881804:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311595136 00000100:00100000:1.0:1782480658.881815:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311595136 00000100:00100000:1.0:1782480658.881862:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1782480658.881873:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+15:8319:x1869066311595136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480658.882119:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+15:8319:x1869066311595136:12345-0@lo:502:llog_process_th.0 Request processed in 247us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480658.882127:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1782480658.882387:0:8319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8319:1869066311595136:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782480658.882420:0:8319:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1782480658.883853:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1782480658.883892:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782480658.883905:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d400/0x3dc3ebf33c023a2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a36 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480658.883926:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d400/0x3dc3ebf33c023a2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a36 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480658.883936:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1782480658.883939:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1782480658.883942:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1782480658.883980:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c023a3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480658.883988:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c023a3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480658.883998:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c023a3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480658.884020:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311595264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782480658.884207:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480658.884263:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45f6ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1782480658.884327:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311595264 00000100:00100000:3.0:1782480658.884334:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311595264 00000100:00100000:3.0:1782480658.884384:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1782480658.884393:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+15:5804:x1869066311595264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480658.884406:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480658.884432:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d413f4e00/0x3dc3ebf33c023a44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023a3d expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480658.884456:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d413f4e00/0x3dc3ebf33c023a44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023a3d expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480658.884467:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d413f4e00/0x3dc3ebf33c023a44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023a3d expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480658.884476:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d413f4e00, rc 0) 00000100:00100000:3.0:1782480658.884515:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+16:5804:x1869066311595264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480658.884522:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1782480658.885225:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311595264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480658.885242:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c023a3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a44 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480658.885251:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c023a3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023a44 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480658.885324:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311595392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480658.885354:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480658.885387:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45f6ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1782480658.885403:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311595392 00000100:00100000:1.0:1782480658.885408:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311595392 00000100:00100000:1.0:1782480658.885430:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1782480658.885437:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+16:5804:x1869066311595392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480658.886299:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+16:5804:x1869066311595392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 858us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480658.886308:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1782480658.891686:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311595392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480658.892139:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311595520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782480658.892215:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480658.892257:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae5d780 going to sleep for 11 seconds 00000100:00100000:3.0:1782480658.893000:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311595520 00000100:00100000:3.0:1782480658.893009:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311595520 00000100:00100000:3.0:1782480658.893059:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1782480658.893176:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+16:5804:x1869066311595520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782480658.893415:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+16:5804:x1869066311595520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 242us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480658.893484:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311595520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782480658.896314:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1782480658.896406:0:8320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8320:1869066311595648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480658.896483:0:8320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480658.896566:0:8320:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45f6e480 going to sleep for 11 seconds 00000100:00100000:0.0:1782480658.896609:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311595648 00000100:00100000:0.0:1782480658.896616:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311595648 00000100:00100000:0.0:1782480658.896688:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1782480658.896697:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+16:8320:x1869066311595648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782480658.897032:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+16:8320:x1869066311595648:12345-0@lo:502:llog_process_th.0 Request processed in 336us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480658.897039:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1782480658.897111:0:8320:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8320:1869066311595648:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782480658.897140:0:8320:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782480658.897150:0:8320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480658.897152:0:8320:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1782480658.897157:0:8320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782480658.897179:0:8320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8320:1869066311595776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480658.897219:0:8320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480658.897452:0:8320:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d526753c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480658.897511:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311595776 00000100:00100000:1.0:1782480658.897516:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311595776 00000100:00100000:1.0:1782480658.897538:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1782480658.897545:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+16:8320:x1869066311595776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480658.897673:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+16:8320:x1869066311595776:12345-0@lo:502:llog_process_th.0 Request processed in 129us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480658.897680:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1782480658.897806:0:8320:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8320:1869066311595776:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782480658.898050:0:8320:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782480658.898056:0:8320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480658.898058:0:8320:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1782480658.898129:0:8320:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1782480658.898330:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1782480658.898347:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1782480658.898357:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c023a3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a44 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480658.898375:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c023a3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a44 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480658.898385:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782480658.898388:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9b6d47c9a800 from 39 10000000:01000000:1.0:1782480658.898391:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782480658.898418:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c023a4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480658.898426:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c023a4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480658.898435:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c023a4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480658.898452:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d47378a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311595904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782480658.898483:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480658.898559:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45f6e240 going to sleep for 11 seconds 00000100:00100000:0.0:1782480658.898596:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311595904 00000100:00100000:0.0:1782480658.898602:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311595904 00000100:00100000:0.0:1782480658.898662:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1782480658.898669:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+16:5804:x1869066311595904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782480658.898680:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480658.898692:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40031800/0x3dc3ebf33c023a52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023a4b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480658.898713:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40031800/0x3dc3ebf33c023a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023a4b expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480658.898722:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40031800/0x3dc3ebf33c023a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023a4b expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480658.898730:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40031800, rc 0) 00000100:00100000:0.0:1782480658.898790:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311595904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480658.898796:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1782480658.898865:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d47378a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311595904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480658.898877:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c023a4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a52 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480658.898885:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c023a4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023a52 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480658.898942:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d47378a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311596032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480658.898966:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480658.899083:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45f6e240 going to sleep for 11 seconds 00000100:00100000:3.0:1782480658.899220:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311596032 00000100:00100000:3.0:1782480658.899224:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311596032 00000100:00100000:3.0:1782480658.899246:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1782480658.899253:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311596032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480658.899486:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311596032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480658.899493:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1782480658.899564:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d47378a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311596032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480658.899591:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d47378a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311596160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480658.899625:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480658.899645:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45f6e240 going to sleep for 11 seconds 00000100:00100000:3.0:1782480658.899686:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311596160 00000100:00100000:3.0:1782480658.899691:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311596160 00000100:00100000:3.0:1782480658.899707:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1782480658.899712:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311596160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782480658.899860:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311596160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480658.899867:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1782480658.899943:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d47378a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311596160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480658.900460:0:8321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d47378a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8321:1869066311596288:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480658.900495:0:8321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480658.900522:0:8321:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45f6e300 going to sleep for 11 seconds 00000100:00100000:3.0:1782480658.900568:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311596288 00000100:00100000:3.0:1782480658.900573:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311596288 00000100:00100000:3.0:1782480658.900605:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1782480658.900612:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+17:8321:x1869066311596288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480658.900809:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+17:8321:x1869066311596288:12345-0@lo:502:llog_process_th.0 Request processed in 197us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480658.900822:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1782480658.900946:0:8321:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d47378a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8321:1869066311596288:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480658.900987:0:8321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d47378a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8321:1869066311596416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480658.901018:0:8321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480658.901044:0:8321:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45f6e300 going to sleep for 11 seconds 00000100:00100000:3.0:1782480658.903247:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311596416 00000100:00100000:3.0:1782480658.903261:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311596416 00000100:00100000:3.0:1782480658.903308:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1782480658.903317:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+17:8321:x1869066311596416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480658.903587:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+17:8321:x1869066311596416:12345-0@lo:502:llog_process_th.0 Request processed in 271us (2567us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480658.903595:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1782480658.903887:0:8321:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d47378a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8321:1869066311596416:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1782480658.903935:0:8321:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1782480658.904158:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1782480658.904182:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782480658.904194:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c023a4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a52 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480658.904205:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c023a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a52 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480658.904215:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1782480658.904217:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1782480658.904220:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782480658.904252:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d40031200/0x3dc3ebf33c023a59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480658.904259:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d40031200/0x3dc3ebf33c023a59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480658.904267:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d40031200/0x3dc3ebf33c023a59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480658.904285:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311596544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782480658.904320:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480658.904351:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae5dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480658.906044:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311596544 00000100:00100000:3.0:1782480658.906057:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311596544 00000100:00100000:3.0:1782480658.906118:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1782480658.906127:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311596544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480658.906143:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480658.906162:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d413f5e00/0x3dc3ebf33c023a60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023a59 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480658.906190:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d413f5e00/0x3dc3ebf33c023a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023a59 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480658.906200:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d413f5e00/0x3dc3ebf33c023a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023a59 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480658.906209:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d413f5e00, rc 0) 00000100:00100000:3.0:1782480658.906280:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311596544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480658.906286:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1782480658.906525:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311596544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480658.906543:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d40031200/0x3dc3ebf33c023a59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a60 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480658.906552:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d40031200/0x3dc3ebf33c023a59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023a60 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480658.906614:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d47378a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311596672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480658.906647:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480658.906697:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45f6e300 going to sleep for 11 seconds 00000100:00100000:0.0:1782480658.906742:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311596672 00000100:00100000:0.0:1782480658.906778:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311596672 00000100:00100000:0.0:1782480658.906804:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782480658.906811:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311596672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480658.907059:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311596672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 247us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480658.907077:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1782480658.907673:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d47378a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311596672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480658.907709:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d47378a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311596800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480658.907766:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480658.907783:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45f6e300 going to sleep for 11 seconds 00000100:00100000:2.0:1782480658.907840:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311596800 00000100:00100000:2.0:1782480658.907845:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311596800 00000100:00100000:1.0:1782480658.908857:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1782480658.908867:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311596800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480658.909079:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311596800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480658.909086:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1782480658.909633:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d47378a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311596800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782480658.910242:0:8322:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8322:1869066311596928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782480658.910296:0:8322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480658.910338:0:8322:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae5dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480658.910388:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311596928 00000100:00100000:3.0:1782480658.910400:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311596928 00000100:00100000:3.0:1782480658.910436:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1782480658.910444:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+18:8322:x1869066311596928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480658.910671:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+18:8322:x1869066311596928:12345-0@lo:502:llog_process_th.0 Request processed in 227us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480658.910679:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1782480658.911308:0:8322:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8322:1869066311596928:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782480658.911340:0:8322:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782480658.911350:0:8322:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480658.911352:0:8322:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782480658.911357:0:8322:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782480658.911383:0:8322:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8322:1869066311597056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782480658.911425:0:8322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480658.911458:0:8322:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae5dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480658.911618:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311597056 00000100:00100000:1.0:1782480658.911624:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311597056 00000100:00100000:1.0:1782480658.911653:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1782480658.911660:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d68bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+18:8322:x1869066311597056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480658.911862:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d68bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+18:8322:x1869066311597056:12345-0@lo:502:llog_process_th.0 Request processed in 202us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480658.911869:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1782480658.912045:0:8322:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8322:1869066311597056:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782480658.912136:0:8322:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480658.912142:0:8322:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480658.912143:0:8322:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782480658.912148:0:8322:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1782480658.912259:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1782480658.912276:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782480658.912286:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d40031200/0x3dc3ebf33c023a59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a60 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480658.912297:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d40031200/0x3dc3ebf33c023a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a60 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480658.912308:0:5804:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1782480658.912310:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9b6d4845cd40 from 1 10000000:01000000:2.0:1782480658.912313:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782480658.912337:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d600/0x3dc3ebf33c023a67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480658.912346:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d600/0x3dc3ebf33c023a67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480658.912355:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d600/0x3dc3ebf33c023a67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480658.912382:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b331f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311597184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782480658.912415:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480658.912431:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f2506c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480658.912506:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311597184 00000100:00100000:3.0:1782480658.912511:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311597184 00000100:00100000:3.0:1782480658.912532:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1782480658.912539:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d68bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311597184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480658.912548:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480658.912561:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d821ed600/0x3dc3ebf33c023a6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023a67 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480658.912583:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d821ed600/0x3dc3ebf33c023a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023a67 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480658.912593:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d821ed600/0x3dc3ebf33c023a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023a67 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480658.912615:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ed600, rc 0) 00000100:00100000:3.0:1782480658.912645:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d68bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311597184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480658.912651:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1782480658.913156:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b331f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311597184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480658.913170:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d600/0x3dc3ebf33c023a67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a6e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480658.913179:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d600/0x3dc3ebf33c023a67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023a6e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480658.913227:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b331f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311597312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480658.913254:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480658.913274:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f2506c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480658.913549:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311597312 00000100:00100000:3.0:1782480658.913554:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311597312 00000100:00100000:3.0:1782480658.913588:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1782480658.913595:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d68bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311597312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480658.913863:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d68bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311597312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (608us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782480658.913871:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1782480658.914038:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b331f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311597312:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1782480658.914139:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782480658.914148:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d600/0x3dc3ebf33c023a67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a6e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480658.914158:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d600/0x3dc3ebf33c023a67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a6e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480659.130244:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480659.350066:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480659.356462:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291647232 00000100:00100000:0.0:1782480659.356479:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291647232 00000100:00100000:0.0:1782480659.356558:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 163 00000100:00100000:0.0:1782480659.356568:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d68bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+8:5584:x1869066291647232:12345-192.168.204.51@tcp:101: 00010000:00010000:0.0:1782480659.356586:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480659.356604:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40031e00/0x3dc3ebf33c023a75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f76d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480659.356653:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40031e00/0x3dc3ebf33c023a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f76d expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480659.356664:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40031e00/0x3dc3ebf33c023a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f76d expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480659.356673:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40031e00, rc 0) 00000100:00100000:0.0:1782480659.356798:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d68bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+9:5584:x1869066291647232:12345-192.168.204.51@tcp:101: Request processed in 230us (6742us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480659.356805:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 163 00000100:00100000:1.0:1782480659.364795:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480659.364997:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291647360 00000100:00100000:3.0:1782480659.365009:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291647360 00000100:00100000:3.0:1782480659.365068:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 164 00000100:00100000:3.0:1782480659.365078:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+9:5584:x1869066291647360:12345-192.168.204.51@tcp:501: 00000100:00100000:3.0:1782480659.367206:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+9:5584:x1869066291647360:12345-192.168.204.51@tcp:501: Request processed in 2121us (2413us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480659.367219:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 164 00000100:00100000:3.0:1782480659.371667:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480659.371778:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291647488 00000100:00100000:2.0:1782480659.371788:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291647488 00000100:00100000:2.0:1782480659.371851:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 165 00000100:00100000:2.0:1782480659.371862:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+9:5584:x1869066291647488:12345-192.168.204.51@tcp:503: 00000100:00100000:2.0:1782480659.372110:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+9:5584:x1869066291647488:12345-192.168.204.51@tcp:503: Request processed in 249us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480659.372119:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 165 00000100:00100000:2.0:1782480659.386223:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480659.387617:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291647616 00000100:00100000:3.0:1782480659.387630:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291647616 00000100:00100000:3.0:1782480659.387933:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 166 00000100:00100000:3.0:1782480659.387945:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+9:6062:x1869066291647616:12345-192.168.204.51@tcp:502: 00000100:00100000:3.0:1782480659.389012:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+9:6062:x1869066291647616:12345-192.168.204.51@tcp:502: Request processed in 1063us (2794us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480659.389024:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 166 00000100:00100000:1.0:1782480659.396938:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480659.397548:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291647744 00000100:00100000:0.0:1782480659.397561:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291647744 00000100:00100000:0.0:1782480659.399181:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 167 00000100:00100000:0.0:1782480659.399202:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+9:6062:x1869066291647744:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782480659.400064:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+9:6062:x1869066291647744:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 863us (3128us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480659.400074:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 167 00000100:00100000:2.0:1782480659.404073:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480659.404236:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291647872 00000100:00100000:3.0:1782480659.404247:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291647872 00000100:00100000:3.0:1782480659.404424:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 168 00000100:00100000:3.0:1782480659.404435:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+9:5584:x1869066291647872:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480659.404451:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480659.404469:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d821ed400/0x3dc3ebf33c023a7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f774 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480659.404511:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d821ed400/0x3dc3ebf33c023a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f774 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480659.404524:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d821ed400/0x3dc3ebf33c023a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f774 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480659.404534:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ed400, rc 0) 00000100:00100000:3.0:1782480659.404605:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:5584:x1869066291647872:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 171us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480659.404612:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 168 00000100:00100000:2.0:1782480659.407714:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480659.407871:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291648000 00000100:00100000:0.0:1782480659.407881:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291648000 00000100:00100000:0.0:1782480659.408022:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 169 00000100:00100000:0.0:1782480659.408032:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:5584:x1869066291648000:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480659.408437:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:5584:x1869066291648000:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 400us (728us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782480659.408454:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 169 00010000:00010000:3.0:1782480660.151026:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480660.216039:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d47378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311597440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480660.216242:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480660.224038:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311597440 00000100:00100000:3.0:1782480660.224053:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311597440 00000100:00080000:1.0:1782480660.224943:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480660.225103:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782480660.225121:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311597440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480660.225276:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480660.225373:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311597440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 259us (9131us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480660.225380:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1782480660.225654:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d47378a80 x1869066311597440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480660.225844:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d47378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311597440:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1782480661.103549:0:8359:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe70f834a0 20000000:00000080:1.0:1782480661.103569:0:8359:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b6d755cac00 uarg=0000000000000000 20000000:01000000:1.0:1782480661.103606:0:8359:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782480661.103612:0:8359:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782480661.103617:0:8359:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1782480661.104877:0:8360:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1782480661.105308:0:8359:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1782480661.110337:0:8359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1782480661.110399:0:8359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1782480661.110470:0:8359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1782480661.110488:0:8359:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1782480661.110507:0:8359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023a83 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480661.110524:0:8359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d413f5800/0x3dc3ebf33c02380d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023806 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480661.110533:0:8359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d82165e00/0x3dc3ebf33c02385a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023853 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480661.110539:0:8359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d821ed800/0x3dc3ebf33c023925 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c02391e expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480661.110548:0:8359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d821ec800/0x3dc3ebf33c0239e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f73c expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480661.110556:0:8359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023a83 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480661.110595:0:8359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d821ec800/0x3dc3ebf33c0239e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f73c expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480661.110611:0:8359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d821ec800/0x3dc3ebf33c0239e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f73c expref: 9 pid: 5801 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480661.110626:0:8359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1869066311597568:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480661.110739:0:8359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d821ed800/0x3dc3ebf33c023925 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c02391e expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480661.111328:0:8359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d821ed800/0x3dc3ebf33c023925 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c02391e expref: 18 pid: 5802 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480661.111341:0:8359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1869066311597696:0@lo:104: 00000100:00100000:0.0:1782480661.111382:0:8359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782480661.111475:0:8359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d82165e00/0x3dc3ebf33c02385a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c023853 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480661.111484:0:8359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d82165e00/0x3dc3ebf33c02385a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c023853 expref: 18 pid: 5802 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480661.111493:0:8359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1869066311597824:0@lo:104: 00000100:00100000:0.0:1782480661.111519:0:8359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480661.114636:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00010000:00010000:0.0:1782480661.114934:0:8359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d413f5800/0x3dc3ebf33c02380d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c023806 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480661.114950:0:8359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d413f5800/0x3dc3ebf33c02380d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c023806 expref: 18 pid: 5799 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480661.114964:0:8359:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1869066311597952:0@lo:104: 00000100:00100000:0.0:1782480661.114998:0:8359:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae5d240 going to sleep for 11 seconds 00000100:00100000:0.0:1782480661.115034:0:8359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1869066311597568:192.168.204.51@tcp:104: 00000100:00100000:1.0:1782480661.115308:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291648128 00000100:00100000:1.0:1782480661.115329:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291648128 00010000:00010000:1.0:1782480661.115364:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d821ec800/0x3dc3ebf33c0239e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f73c expref: 10 pid: 5801 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480661.115392:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:1.0:1782480661.115400:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2367:x1869066291648128:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480661.115568:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480661.115576:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d821ec800/0x3dc3ebf33c0239e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f73c expref: 10 pid: 5801 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480661.115589:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d821ec800/0x3dc3ebf33c0239e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f73c expref: 10 pid: 5801 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480661.115606:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d821ec800/0x3dc3ebf33c0239e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f73c expref: 10 pid: 5801 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480661.115621:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480661.115676:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+9:2367:x1869066291648128:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 276us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480661.115685:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:2.0:1782480661.116890:0:5790:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782480661.116923:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480661.116947:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311597696 00000100:00100000:2.0:1782480661.116953:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311597696 00000100:00100000:2.0:1782480661.116986:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311597824 00000100:00100000:2.0:1782480661.116990:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311597824 00000100:00100000:2.0:1782480661.117002:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311597952 00000100:00100000:2.0:1782480661.117004:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311597952 00000100:00100000:2.0:1782480661.117029:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782480661.117045:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+5:8359:x1869066311597696:12345-0@lo:104: 00010000:00010000:2.0:1782480661.117059:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c02391e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023925 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.117124:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782480661.117140:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+5:8359:x1869066311597696:12345-0@lo:104: Request processed in 105us (5759us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480661.117147:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782480661.117163:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782480661.117169:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d6e541c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+4:8359:x1869066311597824:12345-0@lo:104: 00010000:00010000:2.0:1782480661.117177:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023853 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c02385a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.117210:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782480661.117215:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d6e541c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+4:8359:x1869066311597824:12345-0@lo:104: Request processed in 47us (5696us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480661.117220:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782480661.117264:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782480661.117271:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b333480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+3:8359:x1869066311597952:12345-0@lo:104: 00010000:00010000:2.0:1782480661.117279:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d82164000/0x3dc3ebf33c023806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c02380d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.117312:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1782480661.117317:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b333480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+3:8359:x1869066311597952:12345-0@lo:104: Request processed in 48us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480661.117323:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1782480661.117342:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782480661.117348:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c02391e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023925 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.117355:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40030400 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:2.0:1782480661.117360:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c02391e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c023925 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.117368:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c02391e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c023925 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480661.117374:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c02391e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c023925 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480661.117379:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782480661.117688:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c02391e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023925 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.117695:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782480661.117714:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c02391e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023925 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.117731:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d40030400/0x3dc3ebf33c02391e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023925 expref: -99 pid: 7479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.117782:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782480661.117787:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023853 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c02385a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.117794:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40030a00 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:2.0:1782480661.117797:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023853 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c02385a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.117804:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023853 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c02385a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480661.117810:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023853 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c02385a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480661.117814:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782480661.117830:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023853 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c02385a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.117836:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782480661.117852:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023853 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c02385a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.117858:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d40030a00/0x3dc3ebf33c023853 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c02385a expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.117878:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480661.117887:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d82164000/0x3dc3ebf33c023806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c02380d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.117892:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d82164000 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:2.0:1782480661.117894:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d82164000/0x3dc3ebf33c023806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c02380d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.117900:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d82164000/0x3dc3ebf33c023806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c02380d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480661.117906:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d82164000/0x3dc3ebf33c023806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c02380d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480661.117910:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782480661.117922:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d82164000/0x3dc3ebf33c023806 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c02380d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.117927:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782480661.117932:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d82164000/0x3dc3ebf33c023806 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c02380d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.117938:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d82164000/0x3dc3ebf33c023806 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c02380d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.117951:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480661.117952:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480661.117954:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480661.117976:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311598080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782480661.118012:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480661.118282:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311598208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782480661.118317:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480661.118335:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782480661.118341:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311598336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782480661.118359:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480661.118388:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311598080 00000100:00100000:2.0:1782480661.118393:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311598080 00000100:00100000:1.0:1782480661.118526:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311598208 00000100:00100000:1.0:1782480661.118531:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311598208 00010000:00010000:2.0:1782480661.118631:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d821ed800/0x3dc3ebf33c023925 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c02391e expref: 20 pid: 5802 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480661.118663:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311598336 00000100:00100000:2.0:1782480661.118667:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311598336 00000100:00100000:0.0:1782480661.118715:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782480661.118725:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b330e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+21:3316:x1869066311598080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782480661.118737:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480661.118767:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d821ed800/0x3dc3ebf33c023925 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c02391e expref: 21 pid: 5802 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480661.118779:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d821ed800/0x3dc3ebf33c023925 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c02391e expref: 21 pid: 5802 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480661.118793:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480661.118828:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b330e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+21:3316:x1869066311598080:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480661.118834:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1782480661.118889:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d82165e00/0x3dc3ebf33c02385a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023853 expref: 21 pid: 5802 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480661.118904:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782480661.118911:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b331500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+21:3317:x1869066311598208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782480661.118919:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480661.118922:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d82165e00/0x3dc3ebf33c02385a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023853 expref: 21 pid: 5802 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480661.118936:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d82165e00/0x3dc3ebf33c02385a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c023853 expref: 21 pid: 5802 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480661.118946:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480661.118976:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b331500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+21:3317:x1869066311598208:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480661.118982:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782480661.119292:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:3.0:1782480661.119307:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480661.119313:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480661.119377:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d413f5800/0x3dc3ebf33c02380d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023806 expref: 20 pid: 5799 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480661.119397:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782480661.119404:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b330000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+20:3317:x1869066311598336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782480661.119527:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480661.119532:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d413f5800/0x3dc3ebf33c02380d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023806 expref: 20 pid: 5799 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.119542:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d413f5800/0x3dc3ebf33c02380d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c023806 expref: 20 pid: 5799 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.119555:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023a83 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.119564:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023a83 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.119580:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023a83 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.119595:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023a83 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.119602:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023a83 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.119608:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023a83 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.119613:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40031a00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480661.119617:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023a83 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.119624:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023a83 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.119632:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023a83 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480661.119641:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480661.119669:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b330000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+20:3317:x1869066311598336:12345-0@lo:103:ldlm_bl.0 Request processed in 266us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480661.119676:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782480661.119709:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311598336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782480661.119717:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311598208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782480661.119820:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311598080:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782480661.119907:0:8359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d821ed800/0x3dc3ebf33c023925 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c02391e expref: 19 pid: 5802 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480661.119920:0:8359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1869066311597696:0@lo:104: 00010000:00010000:1.0:1782480661.119934:0:8359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d82165e00/0x3dc3ebf33c02385a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c023853 expref: 18 pid: 5802 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480661.119944:0:8359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1869066311597824:0@lo:104: 00010000:00010000:1.0:1782480661.119953:0:8359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d413f5800/0x3dc3ebf33c02380d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c023806 expref: 17 pid: 5799 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480661.119962:0:8359:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1869066311597952:0@lo:104: 00010000:00010000:1.0:1782480661.119981:0:8359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023a83 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480661.119990:0:8359:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023a83 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480661.119996:0:8359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023a83 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480661.120002:0:8359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023a83 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480661.180501:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480662.205954:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782480662.518800:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782480662.518814:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9b6d7581c000 from 4 10000000:01000000:2.0:1782480662.518820:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782480662.518878:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873da00/0x3dc3ebf33c023a8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480662.518890:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d6873da00/0x3dc3ebf33c023a8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480662.518902:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d6873da00/0x3dc3ebf33c023a8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480662.518930:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b332680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311598464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782480662.518998:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480662.519051:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f250300 going to sleep for 11 seconds 00000100:00100000:1.0:1782480662.519088:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311598464 00000100:00100000:1.0:1782480662.519095:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311598464 00000100:00100000:1.0:1782480662.519153:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1782480662.519162:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+16:5804:x1869066311598464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480662.519177:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480662.519190:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d82164000/0x3dc3ebf33c023a91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023a8a expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480662.519215:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d82164000/0x3dc3ebf33c023a91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023a8a expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480662.519227:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d82164000/0x3dc3ebf33c023a91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023a8a expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480662.519237:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d82164000, rc 0) 00000100:00100000:1.0:1782480662.519277:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311598464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480662.519284:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1782480662.519335:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b332680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311598464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480662.519349:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d6873da00/0x3dc3ebf33c023a8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a91 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480662.519358:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d6873da00/0x3dc3ebf33c023a8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023a91 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480662.519412:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311598592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480662.519442:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480662.519457:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45f6ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1782480662.520188:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311598592 00000100:00100000:1.0:1782480662.520195:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311598592 00000100:00100000:1.0:1782480662.520237:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1782480662.520245:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311598592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480662.521857:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311598592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1606us (2407us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480662.521872:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1782480662.522192:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311598592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480662.522251:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311598720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782480662.522300:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480662.522343:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae5d240 going to sleep for 11 seconds 00000100:00100000:1.0:1782480662.522555:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311598720 00000100:00100000:1.0:1782480662.522562:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311598720 00000100:00100000:1.0:1782480662.522603:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1782480662.522611:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311598720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480662.523865:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311598720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1250us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480662.523875:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1782480662.523921:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311598720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782480662.529482:0:8415:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8415:1869066311598848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782480662.529597:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480662.529675:0:8415:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae5d900 going to sleep for 11 seconds 00000100:00100000:3.0:1782480662.529902:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311598848 00000100:00100000:3.0:1782480662.529911:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311598848 00000100:00100000:3.0:1782480662.529966:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1782480662.529977:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+17:8415:x1869066311598848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480662.530290:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+17:8415:x1869066311598848:12345-0@lo:502:llog_process_th.0 Request processed in 313us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480662.530297:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1782480662.530368:0:8415:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8415:1869066311598848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782480662.530409:0:8415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782480662.530421:0:8415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480662.530424:0:8415:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782480662.530431:0:8415:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6d7581c000 00000020:00000080:3.0:1782480662.530433:0:8415:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782480662.531863:0:8415:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8415:1869066311598976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782480662.531915:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480662.531955:0:8415:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae5d780 going to sleep for 11 seconds 00000100:00100000:1.0:1782480662.532007:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311598976 00000100:00100000:1.0:1782480662.532014:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311598976 00000100:00100000:1.0:1782480662.532063:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1782480662.532073:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+17:8415:x1869066311598976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480662.532270:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+17:8415:x1869066311598976:12345-0@lo:502:llog_process_th.0 Request processed in 198us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480662.532278:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1782480662.532329:0:8415:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8415:1869066311598976:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782480662.532356:0:8415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480662.532363:0:8415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480662.532369:0:8415:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1782480662.532374:0:8415:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1782480662.539030:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1782480662.539070:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782480662.539084:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873da00/0x3dc3ebf33c023a8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a91 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480662.539098:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d6873da00/0x3dc3ebf33c023a8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a91 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480662.539110:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782480662.539114:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9b6d46055800 from 4 10000000:01000000:2.0:1782480662.539116:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782480662.539157:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c000/0x3dc3ebf33c023a98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480662.539178:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c000/0x3dc3ebf33c023a98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480662.539190:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c000/0x3dc3ebf33c023a98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480662.539244:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b332d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311599104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782480662.539310:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480662.539352:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f250300 going to sleep for 11 seconds 00000100:00100000:0.0:1782480662.540041:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311599104 00000100:00100000:0.0:1782480662.540050:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311599104 00000100:00100000:0.0:1782480662.540109:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1782480662.540118:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311599104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782480662.540132:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480662.540146:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40030a00/0x3dc3ebf33c023a9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023a98 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480662.541043:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40030a00/0x3dc3ebf33c023a9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023a98 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480662.541056:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40030a00/0x3dc3ebf33c023a9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023a98 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480662.541065:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40030a00, rc 0) 00000100:00100000:0.0:1782480662.541176:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311599104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1057us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480662.541184:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1782480662.545196:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b332d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311599104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480662.545233:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c000/0x3dc3ebf33c023a98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a9f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480662.545246:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c000/0x3dc3ebf33c023a98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023a9f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480662.545318:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b332d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311599232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480662.545378:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480662.545421:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f250300 going to sleep for 11 seconds 00000100:00100000:2.0:1782480662.545444:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311599232 00000100:00100000:2.0:1782480662.545449:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311599232 00000100:00100000:2.0:1782480662.545486:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1782480662.545494:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311599232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480662.545771:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311599232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480662.545779:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1782480662.545819:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b332d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311599232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480662.545860:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b332d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311599360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480662.546409:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480662.546441:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f250300 going to sleep for 11 seconds 00000100:00100000:2.0:1782480662.546462:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311599360 00000100:00100000:2.0:1782480662.546467:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311599360 00000100:00100000:2.0:1782480662.546494:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1782480662.546500:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311599360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480662.546799:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311599360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 297us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480662.546806:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1782480662.546863:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b332d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311599360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782480662.552889:0:8419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8419:1869066311599488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480662.552984:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480662.553034:0:8419:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51139000 going to sleep for 11 seconds 00000100:00100000:3.0:1782480662.553826:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311599488 00000100:00100000:3.0:1782480662.553834:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311599488 00000100:00100000:3.0:1782480662.553891:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1782480662.553902:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+18:8419:x1869066311599488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480662.554151:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+18:8419:x1869066311599488:12345-0@lo:502:llog_process_th.0 Request processed in 251us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480662.554159:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1782480662.554219:0:8419:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8419:1869066311599488:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782480662.554255:0:8419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782480662.554264:0:8419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480662.554267:0:8419:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782480662.554275:0:8419:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6d46055800 00000020:00000080:0.0:1782480662.554278:0:8419:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1782480662.554362:0:8419:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8419:1869066311599616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782480662.554407:0:8419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480662.554440:0:8419:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae5d240 going to sleep for 11 seconds 00000100:00100000:1.0:1782480662.555440:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311599616 00000100:00100000:1.0:1782480662.555449:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311599616 00000100:00100000:1.0:1782480662.555606:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1782480662.555626:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+18:8419:x1869066311599616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480662.555860:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+18:8419:x1869066311599616:12345-0@lo:502:llog_process_th.0 Request processed in 244us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480662.555867:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1782480662.557471:0:8419:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8419:1869066311599616:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782480662.557516:0:8419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782480662.557525:0:8419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480662.557527:0:8419:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1782480662.557533:0:8419:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782480662.560948:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782480662.560985:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782480662.561000:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c000/0x3dc3ebf33c023a98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a9f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480662.561015:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c000/0x3dc3ebf33c023a98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a9f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480662.561037:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782480662.561040:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9b6d47c9a800 from 4 10000000:01000000:3.0:1782480662.561043:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782480662.561085:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aa6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480662.561092:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aa6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480662.561113:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aa6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480662.561138:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311599744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782480662.561205:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480662.561256:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51139000 going to sleep for 11 seconds 00000100:00100000:1.0:1782480662.561537:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311599744 00000100:00100000:1.0:1782480662.561545:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311599744 00000100:00100000:1.0:1782480662.561589:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1782480662.561598:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311599744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480662.561612:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480662.561632:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d82165e00/0x3dc3ebf33c023aad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023aa6 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480662.561655:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d82165e00/0x3dc3ebf33c023aad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023aa6 expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480662.561667:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d82165e00/0x3dc3ebf33c023aad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023aa6 expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480662.561676:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d82165e00, rc 0) 00000100:00100000:1.0:1782480662.561712:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311599744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480662.561719:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1782480662.561905:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311599744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480662.561920:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aa6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023aad expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480662.561928:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aa6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023aad expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480662.561978:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311599872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480662.562004:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480662.562034:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51139000 going to sleep for 11 seconds 00000100:00100000:3.0:1782480662.562048:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311599872 00000100:00100000:3.0:1782480662.562052:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311599872 00000100:00100000:3.0:1782480662.562082:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1782480662.562089:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311599872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480662.562354:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311599872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480662.562361:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1782480662.562390:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311599872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480662.562417:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311600000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782480662.562450:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480662.562464:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51139000 going to sleep for 11 seconds 00000100:00100000:3.0:1782480662.562656:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311600000 00000100:00100000:3.0:1782480662.562660:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311600000 00000100:00100000:3.0:1782480662.562678:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1782480662.562683:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311600000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782480662.562868:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311600000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480662.562876:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1782480662.562914:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311600000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480662.563631:0:8421:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8421:1869066311600128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480662.563683:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480662.563717:0:8421:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d751dba80 going to sleep for 11 seconds 00000100:00100000:3.0:1782480662.564200:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311600128 00000100:00100000:3.0:1782480662.564206:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311600128 00000100:00100000:3.0:1782480662.564254:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1782480662.564263:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:8421:x1869066311600128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480662.564643:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:8421:x1869066311600128:12345-0@lo:502:llog_process_th.0 Request processed in 380us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480662.564651:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1782480662.564742:0:8421:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8421:1869066311600128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782480662.564795:0:8421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782480662.564804:0:8421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480662.564806:0:8421:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782480662.564813:0:8421:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6d47c9a800 00000020:00000080:1.0:1782480662.564816:0:8421:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782480662.565263:0:8421:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8421:1869066311600256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480662.565314:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480662.565358:0:8421:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d79c6c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480662.565483:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311600256 00000100:00100000:2.0:1782480662.565490:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311600256 00000100:00100000:2.0:1782480662.565529:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1782480662.565537:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:8421:x1869066311600256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480662.565785:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:8421:x1869066311600256:12345-0@lo:502:llog_process_th.0 Request processed in 248us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480662.565792:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1782480662.566252:0:8421:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:8421:1869066311600256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782480662.566274:0:8421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480662.566281:0:8421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480662.566282:0:8421:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1782480662.566287:0:8421:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1782480662.566512:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1782480662.566538:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782480662.566550:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aa6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023aad expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480662.566561:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aa6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023aad expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480662.743251:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480662.743337:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291648256 00000100:00100000:3.0:1782480662.743360:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291648256 00000100:00100000:3.0:1782480662.743531:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 185 00000100:00100000:3.0:1782480662.743542:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+9:5584:x1869066291648256:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480662.743561:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480662.743582:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d821ecc00/0x3dc3ebf33c023ab4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f77b expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480662.743618:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d821ecc00/0x3dc3ebf33c023ab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f77b expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480662.743629:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d821ecc00/0x3dc3ebf33c023ab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f77b expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480662.743640:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ecc00, rc 0) 00000100:00100000:3.0:1782480662.743706:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:5584:x1869066291648256:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 166us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480662.743714:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 185 00000100:00100000:2.0:1782480662.748292:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480662.748513:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291648384 00000100:00100000:1.0:1782480662.748524:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291648384 00000100:00100000:1.0:1782480662.748629:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 186 00000100:00100000:1.0:1782480662.748641:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:5584:x1869066291648384:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480662.749034:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:5584:x1869066291648384:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 395us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480662.749042:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 186 00000100:00100000:2.0:1782480662.765435:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480662.765605:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291648512 00000100:00100000:3.0:1782480662.765617:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291648512 00000100:00100000:3.0:1782480662.765679:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 187 00000100:00100000:3.0:1782480662.765691:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:5584:x1869066291648512:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782480662.765975:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:5584:x1869066291648512:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 285us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480662.765984:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 187 00000100:00100000:1.0:1782480662.782014:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480662.782202:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291648640 00000100:00100000:2.0:1782480662.782212:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291648640 00000100:00100000:2.0:1782480662.782289:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 188 00000100:00100000:2.0:1782480662.782298:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:6126:x1869066291648640:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782480662.782577:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:6126:x1869066291648640:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 278us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480662.782586:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 188 00000100:00100000:0.0:1782480662.801210:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480662.802087:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291648768 00000100:00100000:3.0:1782480662.802159:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291648768 00000100:00100000:3.0:1782480662.802231:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 189 00000100:00100000:3.0:1782480662.802242:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:6126:x1869066291648768:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782480662.802866:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:6126:x1869066291648768:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 622us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480662.802877:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 189 00000100:00100000:0.0:1782480663.131843:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480663.131879:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480663.131920:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480663.131948:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291649024 00000100:00100000:0.0:1782480663.131958:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291649024 00000100:00100000:0.0:1782480663.132036:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291649152 00000100:00100000:0.0:1782480663.132039:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291649152 00000100:00100000:0.0:1782480663.132056:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:0.0:1782480663.132066:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2369:x1869066291649024:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480663.132137:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2369:x1869066291649024:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 72us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480663.132145:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:0.0:1782480663.132164:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:0.0:1782480663.132171:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2369:x1869066291649152:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480663.132196:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2369:x1869066291649152:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 24us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480663.132201:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:2.0:1782480663.136669:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291648896 00000100:00100000:2.0:1782480663.136687:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291648896 00000100:00100000:2.0:1782480663.136784:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:2.0:1782480663.136799:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2369:x1869066291648896:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480663.136897:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2369:x1869066291648896:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 103us (5016us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480663.136905:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00080000:1.0:1782480663.138092:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782480663.138098:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782480663.138108:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782480663.222911:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480663.287972:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311600384:0@lo:400:kworker.0 00000100:00100000:2.0:1782480663.288056:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480663.288220:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311600384 00000100:00100000:0.0:1782480663.288229:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311600384 00000100:00100000:0.0:1782480663.288277:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1782480663.288286:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311600384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480663.288340:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311600384:12345-0@lo:400:kworker.0 Request processed in 55us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480663.288348:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1782480663.288683:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311600384:0@lo:400:kworker.0 00000100:00100000:2.0:1782480663.288692:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311600896:0@lo:400:kworker.0 00000100:00100000:2.0:1782480663.288717:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480663.288778:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782480663.288785:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311600512:0@lo:400:kworker.0 00000100:00100000:2.0:1782480663.288804:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480663.288840:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311601024:0@lo:400:kworker.0 00000100:00100000:2.0:1782480663.288863:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480663.288892:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311600640:0@lo:400:kworker.0 00000100:00100000:2.0:1782480663.288914:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480663.288939:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782480663.288945:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311600768:0@lo:400:kworker.0 00000100:00100000:2.0:1782480663.288964:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480663.289073:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311600896 00000100:00100000:0.0:1782480663.289079:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311600896 00000100:00100000:0.0:1782480663.289122:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311600512 00000100:00100000:0.0:1782480663.289126:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311600512 00000100:00100000:0.0:1782480663.289137:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311600640 00000100:00100000:0.0:1782480663.289145:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311600640 00000100:00100000:0.0:1782480663.289164:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782480663.289170:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311600896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480663.289213:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311600896:12345-0@lo:400:kworker.0 Request processed in 43us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480663.289220:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782480663.289234:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782480663.289240:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311600512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480663.289267:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311600512:12345-0@lo:400:kworker.0 Request processed in 27us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480663.289273:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782480663.289283:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782480663.289288:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311600640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480663.289312:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311600640:12345-0@lo:400:kworker.0 Request processed in 24us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480663.289317:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1782480663.289333:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480663.289436:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311600640:0@lo:400:kworker.0 00000100:00100000:2.0:1782480663.289466:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311601024 00000100:00100000:2.0:1782480663.289469:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311601024 00000100:00100000:2.0:1782480663.289508:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311600768 00000100:00100000:2.0:1782480663.289511:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311600768 00000100:00100000:2.0:1782480663.289527:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782480663.289533:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311601024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480663.289565:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311601024:12345-0@lo:400:kworker.0 Request processed in 32us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480663.289571:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782480663.290199:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782480663.290210:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311600768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480663.290262:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311600768:12345-0@lo:400:kworker.0 Request processed in 55us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480663.290268:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1782480663.290319:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d4981fb80 x1869066311600768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480663.290333:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311600768:0@lo:400:kworker.0 00000100:00100000:2.0:1782480663.290366:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311600512:0@lo:400:kworker.0 00010000:00080000:2.0:1782480663.290378:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d4981d500 x1869066311601024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480663.290386:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311601024:0@lo:400:kworker.0 00000100:00100000:2.0:1782480663.290406:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311600896:0@lo:400:kworker.0 00000100:00080000:0.0:1782480663.290568:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782480663.290648:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782480663.798966:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782480663.798992:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311601152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480663.799061:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480663.799237:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311601152 00000100:00100000:0.0:1782480663.799245:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311601152 00000100:00100000:0.0:1782480663.799304:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782480663.799314:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311601152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782480663.799350:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480663.799466:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311601152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480663.799475:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1782480663.802406:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d4737b100 x1869066311601152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480663.802436:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311601152:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782480664.248233:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480665.270957:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480665.335168:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311601280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480665.335241:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480665.335392:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311601280 00000100:00100000:1.0:1782480665.335400:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311601280 00000100:00100000:1.0:1782480665.335461:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782480665.335471:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311601280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782480665.335518:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480665.335562:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311601280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480665.335569:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1782480665.336318:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782480665.336354:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d4737b100 x1869066311601280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480665.336374:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4737b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311601280:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782480666.295248:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480667.318983:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782480667.812647:0:8659:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1782480668.246949:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480668.246989:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291649280 00000100:00100000:3.0:1782480668.246992:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480668.247000:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291649280 00000100:00100000:3.0:1782480668.247032:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480668.247053:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 191 00000100:00100000:3.0:1782480668.247057:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480668.247063:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2367:x1869066291649280:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480668.247080:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291649408 00000100:00100000:3.0:1782480668.247083:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291649408 00000100:00100000:3.0:1782480668.247119:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:3.0:1782480668.247126:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2367:x1869066291649408:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480668.247133:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2367:x1869066291649280:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 71us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480668.247139:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 191 00000100:00100000:3.0:1782480668.247153:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2367:x1869066291649408:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 29us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480668.247159:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:3.0:1782480668.247174:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291649536 00000100:00100000:3.0:1782480668.247177:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291649536 00000100:00100000:3.0:1782480668.247214:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291649664 00000100:00100000:3.0:1782480668.247217:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291649664 00000100:00100000:3.0:1782480668.247232:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:3.0:1782480668.247237:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2367:x1869066291649536:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480668.247289:0:6605:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1782480668.247299:0:6605:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1782480668.247448:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2367:x1869066291649536:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 209us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480668.247464:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:3.0:1782480668.247477:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:3.0:1782480668.247483:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2367:x1869066291649664:12345-192.168.204.51@tcp:400:kworker.0 00000100:00080000:1.0:1782480668.251012:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782480668.251021:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782480668.251024:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480668.261103:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2367:x1869066291649664:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 13607us (14031us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480668.261119:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00010000:00010000:1.0:1782480668.343083:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480668.407000:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311601664:0@lo:400:kworker.0 00000100:00100000:0.0:1782480668.407070:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480668.407127:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480668.407134:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311601792:0@lo:400:kworker.0 00000100:00100000:0.0:1782480668.407163:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480668.407197:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311601664 00000100:00100000:0.0:1782480668.407204:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311601664 00000100:00100000:0.0:1782480668.407275:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782480668.407284:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311601664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480668.407344:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311601664:12345-0@lo:400:kworker.0 Request processed in 61us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480668.407351:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1782480668.407374:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480668.407432:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311601408:0@lo:400:kworker.0 00000100:00100000:2.0:1782480668.407478:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480668.407504:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311601920:0@lo:400:kworker.0 00000100:00100000:2.0:1782480668.407526:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480668.407546:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782480668.407552:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311601536:0@lo:400:kworker.0 00000100:00100000:2.0:1782480668.407587:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480668.407602:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311602048:0@lo:400:kworker.0 00000100:00100000:2.0:1782480668.407623:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480668.407666:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311601792 00000100:00100000:2.0:1782480668.407670:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311601792 00000100:00100000:2.0:1782480668.407708:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311602048 00000100:00100000:2.0:1782480668.407711:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311602048 00000100:00100000:2.0:1782480668.407744:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782480668.407773:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311601792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480668.407812:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311601792:12345-0@lo:400:kworker.0 Request processed in 39us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480668.407818:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782480668.407847:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782480668.407853:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311602048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480668.407888:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311602048:12345-0@lo:400:kworker.0 Request processed in 36us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480668.407895:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782480668.407911:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311601920 00000100:00100000:2.0:1782480668.407915:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311601920 00000100:00100000:2.0:1782480668.407935:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311601536 00000100:00100000:2.0:1782480668.407939:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311601536 00000100:00100000:2.0:1782480668.407950:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782480668.407955:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311601920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480668.407990:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311601920:12345-0@lo:400:kworker.0 Request processed in 35us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480668.407997:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782480668.408008:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782480668.408013:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311601536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480668.408038:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311601536:12345-0@lo:400:kworker.0 Request processed in 25us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480668.408044:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782480668.408085:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311601536:0@lo:400:kworker.0 00010000:00080000:2.0:1782480668.408098:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d4981df80 x1869066311602048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480668.408109:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311602048:0@lo:400:kworker.0 00000100:00100000:2.0:1782480668.408120:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311601920:0@lo:400:kworker.0 00010000:00080000:3.0:1782480668.408790:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d4981e680 x1869066311601792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480668.408801:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311601792:0@lo:400:kworker.0 00000100:00100000:3.0:1782480668.408812:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311601664:0@lo:400:kworker.0 00000100:00100000:0.0:1782480668.409818:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311601408 00000100:00100000:0.0:1782480668.409828:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311601408 00000100:00100000:0.0:1782480668.409864:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1782480668.409883:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311601408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480668.409943:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311601408:12345-0@lo:400:kworker.0 Request processed in 62us (2464us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480668.409950:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:0.0:1782480668.410139:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782480668.410144:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782480668.410157:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480668.410183:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311601408:0@lo:400:kworker.0 00000100:00100000:0.0:1782480668.919290:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311602176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480668.919369:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480668.919457:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311602176 00000100:00100000:1.0:1782480668.919465:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311602176 00000100:00100000:1.0:1782480668.919519:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782480668.919529:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311602176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480668.919572:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480668.924580:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311602176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5041us (5199us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480668.924596:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1782480668.924970:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d473d8700 x1869066311602176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480668.924996:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311602176:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782480669.368907:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480670.393156:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480670.456045:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311602304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480670.456119:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480670.456663:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311602304 00000100:00100000:2.0:1782480670.456677:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311602304 00000100:00100000:2.0:1782480670.456741:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782480670.456766:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311602304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782480670.456813:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480670.456865:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311602304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480670.456873:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1782480670.456894:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782480670.456929:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7b330700 x1869066311602304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480670.456963:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311602304:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782480671.414998:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480672.439655:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480673.388192:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480673.388254:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480673.388286:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480673.388622:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291650048 00000100:00100000:3.0:1782480673.388654:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291650048 00000100:00100000:3.0:1782480673.388714:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291650176 00000100:00100000:3.0:1782480673.388718:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291650176 00000100:00100000:3.0:1782480673.388742:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:3.0:1782480673.388770:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2365:x1869066291650048:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:3.0:1782480673.388817:0:6604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c0239f0 00000100:00080000:3.0:1782480673.388827:0:6604:0:(import.c:65:import_set_state_nolock()) ffff9b6d74c75000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782480673.388863:0:6604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1782480673.389216:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+2:2365:x1869066291650048:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 447us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480673.389224:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:3.0:1782480673.389240:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1782480673.389247:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2365:x1869066291650176:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:3.0:1782480673.389272:0:6604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c0239f7 00000100:00080000:3.0:1782480673.389278:0:6604:0:(import.c:65:import_set_state_nolock()) ffff9b6d74c71800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782480673.389299:0:6604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1782480673.389492:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+2:2365:x1869066291650176:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 244us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480673.389499:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00080000:3.0:1782480673.390215:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782480673.390220:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480673.390288:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00010000:00010000:0.0:1782480673.390329:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480673.390351:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291649792 00000100:00100000:0.0:1782480673.390358:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291649792 00000100:00100000:0.0:1782480673.390397:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 193 00000100:00100000:0.0:1782480673.390404:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2369:x1869066291649792:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480673.390448:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2369:x1869066291649792:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 44us (2194us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480673.390455:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 193 00010000:00010000:0.0:1782480673.390564:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480673.391021:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291649920 00000100:00100000:3.0:1782480673.391026:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291649920 00000100:00100000:3.0:1782480673.391062:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:3.0:1782480673.391069:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2369:x1869066291649920:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480673.391109:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2369:x1869066291649920:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 40us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480673.391115:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00080000:0.0:1782480673.391352:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782480673.462918:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480673.531294:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311602560:0@lo:400:kworker.0 00000100:00100000:3.0:1782480673.531299:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311602688:0@lo:400:kworker.0 00000100:00100000:0.0:1782480673.531375:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311602432:0@lo:400:kworker.0 00000100:00100000:2.0:1782480673.534574:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311602816:0@lo:400:kworker.0 00000100:00100000:3.0:1782480673.540809:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480673.541529:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480673.541577:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311603072:0@lo:400:kworker.0 00000100:00100000:1.0:1782480673.541636:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480673.541889:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311603072 00000100:00100000:1.0:1782480673.541897:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311603072 00000100:00100000:1.0:1782480673.541956:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782480673.541968:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4737b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311603072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480673.542026:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4737b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311603072:12345-0@lo:400:kworker.0 Request processed in 62us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480673.542033:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1782480673.542056:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782480673.542101:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7ac1c000 x1869066311603072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480673.542114:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311603072:0@lo:400:kworker.0 00000100:00100000:1.0:1782480673.542157:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311602688 00000100:00100000:1.0:1782480673.542161:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311602688 00000100:00100000:1.0:1782480673.542189:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311602560 00000100:00100000:1.0:1782480673.542192:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311602560 00000100:00100000:1.0:1782480673.542206:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782480673.542212:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311602688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480673.542270:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311602688:12345-0@lo:400:kworker.0 Request processed in 58us (1472us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480673.542277:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782480673.542289:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782480673.542296:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311602560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480673.542327:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311602560:12345-0@lo:400:kworker.0 Request processed in 32us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480673.542333:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1782480673.542349:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480673.542372:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311602688:0@lo:400:kworker.0 00000100:00100000:0.0:1782480673.545253:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480673.545297:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311602432 00000100:00100000:0.0:1782480673.545305:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311602432 00000100:00100000:0.0:1782480673.546427:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1782480673.546440:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311602432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480673.546509:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311602432:12345-0@lo:400:kworker.0 Request processed in 72us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480673.546515:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1782480673.546581:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311602432:0@lo:400:kworker.0 00000100:00100000:0.0:1782480673.546594:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311602944:0@lo:400:kworker.0 00000100:00100000:0.0:1782480673.546639:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480673.550957:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311602560:0@lo:400:kworker.0 00000100:00100000:2.0:1782480673.551097:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480673.551137:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311602816 00000100:00100000:2.0:1782480673.551144:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311602816 00000100:00100000:2.0:1782480673.551196:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782480673.551206:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b330700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311602816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480673.551207:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311602944 00000100:00100000:1.0:1782480673.551215:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311602944 00000100:00100000:1.0:1782480673.551257:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782480673.551263:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b330700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311602816:12345-0@lo:400:kworker.0 Request processed in 58us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480673.551269:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311602944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480673.551276:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1782480673.551300:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782480673.551305:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480673.551320:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311602944:12345-0@lo:400:kworker.0 Request processed in 55us (4680us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480673.551329:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1782480673.551341:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d473d9f80 x1869066311602816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480673.551353:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311602816:0@lo:400:kworker.0 00000100:00100000:1.0:1782480673.552829:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311602944:0@lo:400:kworker.0 00000001:02000400:3.0:1782480673.930657:0:8904:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing yml_node 00000100:00100000:2.0:1782480674.039793:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311603200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480674.039869:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480674.040191:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311603200 00000100:00100000:1.0:1782480674.040199:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311603200 00000100:00100000:1.0:1782480674.040256:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782480674.040267:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311603200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480674.040307:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480674.040357:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311603200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480674.040375:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1782480674.040417:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d473d8700 x1869066311603200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480674.040435:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311603200:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782480674.493856:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782480674.690572:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 49099535-dcd3-436f-aa96-9770a3f52e5b 00000020:00000080:0.0:1782480674.690582:0:6628:0:(genops.c:906:class_export_put()) final put ffff9b6d74c73000/49099535-dcd3-436f-aa96-9770a3f52e5b 00000020:00000080:3.0:1782480674.692372:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d74c73000/49099535-dcd3-436f-aa96-9770a3f52e5b for lustre-OST0000 00000020:00000080:3.0:1782480674.692430:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6d74c75000 for lustre-OST0000 00010000:00010000:0.0:1782480675.511362:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480675.575074:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782480675.575100:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311603328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480675.575175:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480675.575416:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311603328 00000100:00100000:2.0:1782480675.575424:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311603328 00000100:00100000:2.0:1782480675.575498:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1782480675.575508:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311603328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782480675.575560:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1782480675.575728:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480675.575917:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311603328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 410us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480675.575925:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1782480675.576086:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7b333b80 x1869066311603328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480691 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480675.576106:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311603328:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782480676.535420:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480677.564564:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782480677.705851:0:7497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 49099535-dcd3-436f-aa96-9770a3f52e5b 00000020:00000080:3.0:1782480677.705860:0:7497:0:(genops.c:906:class_export_put()) final put ffff9b6d74c72000/49099535-dcd3-436f-aa96-9770a3f52e5b 00000020:00000080:0.0:1782480677.706112:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d74c72000/49099535-dcd3-436f-aa96-9770a3f52e5b for lustre-OST0001 00000020:00000080:0.0:1782480677.706153:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6d74c71800 for lustre-OST0001 00000001:02000400:3.0:1782480678.479470:0:9100:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.95 00000100:00100000:1.0:1782480678.492320:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480678.492362:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480678.492492:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291650432 00000100:00100000:3.0:1782480678.492502:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291650432 00000100:00100000:3.0:1782480678.492580:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:3.0:1782480678.492590:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2367:x1869066291650432:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480678.495327:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2367:x1869066291650432:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 2726us (2951us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480678.495344:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:0.0:1782480678.495487:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291650304 00000100:00100000:0.0:1782480678.495496:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291650304 00000100:00100000:0.0:1782480678.495567:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 195 00000100:00100000:0.0:1782480678.495578:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2367:x1869066291650304:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480678.495831:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2367:x1869066291650304:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 254us (3516us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480678.495856:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 195 00000100:00080000:1.0:1782480678.496161:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782480678.583908:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480678.646997:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311603584:0@lo:400:kworker.0 00000100:00100000:3.0:1782480678.647088:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480678.647136:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311604096:0@lo:400:kworker.0 00000100:00100000:3.0:1782480678.647162:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480678.647192:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782480678.647198:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311603456:0@lo:400:kworker.0 00000100:00100000:3.0:1782480678.647227:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480678.647257:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066311603968:0@lo:400:kworker.0 00000100:00100000:3.0:1782480678.647279:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480678.647307:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311603840:0@lo:400:kworker.0 00000100:00100000:3.0:1782480678.647330:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480678.647345:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782480678.647350:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1869066311603712:0@lo:400:kworker.0 00000100:00100000:3.0:1782480678.647368:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480678.647394:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311603584 00000100:00100000:3.0:1782480678.647402:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311603584 00000100:00100000:3.0:1782480678.647436:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311603968 00000100:00100000:3.0:1782480678.647438:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311603968 00000100:00100000:3.0:1782480678.647457:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311603712 00000100:00100000:3.0:1782480678.647459:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311603712 00000100:00100000:3.0:1782480678.647472:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782480678.647479:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311603584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480678.647559:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311603584:12345-0@lo:400:kworker.0 Request processed in 79us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480678.647567:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782480678.647583:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782480678.647588:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066311603968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480678.647612:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066311603968:12345-0@lo:400:kworker.0 Request processed in 25us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480678.647618:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782480678.647628:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782480678.647633:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869066311603712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480678.647661:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869066311603712:12345-0@lo:400:kworker.0 Request processed in 27us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480678.647668:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782480678.647705:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1869066311603712:0@lo:400:kworker.0 00000100:00100000:3.0:1782480678.647732:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066311603968:0@lo:400:kworker.0 00000100:00100000:3.0:1782480678.647741:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311603584:0@lo:400:kworker.0 00000100:00100000:1.0:1782480678.648166:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311604096 00000100:00100000:1.0:1782480678.648172:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311604096 00000100:00100000:1.0:1782480678.648212:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311603840 00000100:00100000:1.0:1782480678.648215:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311603840 00000100:00100000:1.0:1782480678.648239:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782480678.648246:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311604096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480678.648288:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311604096:12345-0@lo:400:kworker.0 Request processed in 43us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480678.648294:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782480678.648309:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782480678.648316:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311603840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480678.648355:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311603840:12345-0@lo:400:kworker.0 Request processed in 41us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480678.648361:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1782480678.648379:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782480678.648383:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782480678.648386:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782480678.648406:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d460b0700 x1869066311603840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480678.648416:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311603840:0@lo:400:kworker.0 00010000:00080000:1.0:1782480678.648435:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d460b3480 x1869066311604096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480678.648443:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311604096:0@lo:400:kworker.0 00000100:00100000:0.0:1782480678.661726:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311603456 00000100:00100000:0.0:1782480678.661741:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311603456 00000100:00100000:0.0:1782480678.661946:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1782480678.661957:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3316:x1869066311603456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480678.662065:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3316:x1869066311603456:12345-0@lo:400:kworker.0 Request processed in 110us (14836us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480678.662074:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1782480678.662855:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311603456:0@lo:400:kworker.0 00000100:00100000:2.0:1782480679.159156:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311604224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480679.159232:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480679.159397:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311604224 00000100:00100000:0.0:1782480679.159405:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311604224 00000100:00100000:0.0:1782480679.159474:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782480679.159484:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311604224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782480679.159534:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480679.159590:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311604224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480679.159597:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1782480679.161086:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d473db800 x1869066311604224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480679.161110:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311604224:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782480679.608894:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480680.632033:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480680.701550:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782480680.701572:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311604352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480680.701635:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480680.701776:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311604352 00000100:00100000:0.0:1782480680.701784:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311604352 00000100:00100000:0.0:1782480680.701849:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782480680.701858:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311604352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782480680.701896:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480680.701946:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311604352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480680.701966:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1782480680.702010:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48574a80 x1869066311604352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480680.702028:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311604352:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782480680.702098:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1782480681.054535:0:9197:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.95 00010000:00010000:3.0:1782480681.654829:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480682.679005:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782480683.601391:0:9296:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.95 00000100:00100000:1.0:1782480683.617563:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480683.617614:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480683.617703:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291650560 00000100:00100000:3.0:1782480683.617713:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291650560 00000100:00100000:3.0:1782480683.617899:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 197 00000100:00100000:3.0:1782480683.617910:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2369:x1869066291650560:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480683.617979:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2369:x1869066291650560:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 71us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480683.617988:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 197 00000100:00100000:2.0:1782480683.618068:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291650688 00000100:00100000:2.0:1782480683.618073:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291650688 00000100:00100000:2.0:1782480683.618119:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:2.0:1782480683.618126:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2369:x1869066291650688:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480683.618156:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2369:x1869066291650688:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 31us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480683.618162:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00080000:3.0:1782480683.618208:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782480683.714328:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480683.767020:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311604736:0@lo:400:kworker.0 00000100:00100000:3.0:1782480683.767086:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480683.767144:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782480683.767150:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311604864:0@lo:400:kworker.0 00000100:00100000:3.0:1782480683.767191:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480683.767230:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311604736 00000100:00100000:3.0:1782480683.767237:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311604736 00000100:00100000:3.0:1782480683.767285:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782480683.767294:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311604736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480683.767344:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311604736:12345-0@lo:400:kworker.0 Request processed in 51us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480683.767352:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782480683.767375:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311604864 00000100:00100000:3.0:1782480683.767378:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311604864 00000100:00100000:3.0:1782480683.767406:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782480683.767412:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311604864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480683.767473:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311604864:12345-0@lo:400:kworker.0 Request processed in 45us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480683.767480:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1782480683.767504:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782480683.767508:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782480683.767626:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d460b3480 x1869066311604864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480683.767641:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311604864:0@lo:400:kworker.0 00000100:00100000:3.0:1782480683.767653:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311604736:0@lo:400:kworker.0 00000100:00100000:2.0:1782480683.767725:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311604480:0@lo:400:kworker.0 00000100:00100000:2.0:1782480683.767790:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480683.767817:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311604992:0@lo:400:kworker.0 00000100:00100000:2.0:1782480683.767851:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480683.767873:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782480683.767879:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311604608:0@lo:400:kworker.0 00000100:00100000:2.0:1782480683.767906:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480683.767921:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311605120:0@lo:400:kworker.0 00000100:00100000:2.0:1782480683.767937:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480683.767958:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311604992 00000100:00100000:2.0:1782480683.767961:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311604992 00000100:00100000:2.0:1782480683.767982:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311604608 00000100:00100000:2.0:1782480683.767984:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311604608 00000100:00100000:2.0:1782480683.767995:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782480683.767999:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311604992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480683.768028:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311604992:12345-0@lo:400:kworker.0 Request processed in 28us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480683.768034:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782480683.768045:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782480683.768050:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311604608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480683.768069:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311604608:12345-0@lo:400:kworker.0 Request processed in 19us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480683.768074:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782480683.768091:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311605120 00000100:00100000:2.0:1782480683.768094:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311605120 00000100:00100000:2.0:1782480683.768118:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782480683.768124:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311605120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480683.768151:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311605120:12345-0@lo:400:kworker.0 Request processed in 27us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480683.768156:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1782480683.768172:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782480683.768175:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480683.768193:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311604608:0@lo:400:kworker.0 00010000:00080000:2.0:1782480683.768211:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d460b1f80 x1869066311605120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480683.768219:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311605120:0@lo:400:kworker.0 00000100:00100000:2.0:1782480683.768229:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311604992:0@lo:400:kworker.0 00000100:00100000:3.0:1782480683.768289:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311604480 00000100:00100000:3.0:1782480683.768293:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311604480 00000100:00100000:3.0:1782480683.768322:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1782480683.768328:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311604480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480683.768363:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311604480:12345-0@lo:400:kworker.0 Request processed in 34us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480683.768369:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1782480683.768586:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311604480:0@lo:400:kworker.0 00000100:00100000:0.0:1782480684.279256:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311605248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480684.279336:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480684.279615:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311605248 00000100:00100000:1.0:1782480684.279623:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311605248 00000100:00100000:1.0:1782480684.279690:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782480684.279701:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311605248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480684.279738:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480684.279958:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311605248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 259us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480684.279981:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1782480684.282321:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d473d9180 x1869066311605248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480684.282472:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311605248:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782480684.728425:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782480685.324326:0:9345:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Jun 26 09:31:24 EDT 2026 00010000:00010000:1.0:1782480685.752582:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480685.815253:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7591e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311605376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480685.815339:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480685.815496:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311605376 00000100:00100000:0.0:1782480685.815505:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311605376 00000100:00100000:0.0:1782480685.815582:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782480685.815601:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311605376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782480685.815640:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480685.815702:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311605376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480685.815709:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1782480685.815807:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7591e300 x1869066311605376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480701 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480685.815831:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7591e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311605376:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782480685.815839:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782480686.774927:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480687.801923:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480688.741073:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480688.741126:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480688.741175:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291650816 00000100:00100000:1.0:1782480688.741185:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291650816 00000100:00100000:1.0:1782480688.741242:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 199 00000100:00100000:1.0:1782480688.741250:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2369:x1869066291650816:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480688.741338:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2369:x1869066291650816:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 88us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480688.741346:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 199 00000100:00100000:2.0:1782480688.741737:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291650944 00000100:00100000:2.0:1782480688.741742:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291650944 00000100:00100000:2.0:1782480688.741819:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:2.0:1782480688.741828:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2369:x1869066291650944:12345-192.168.204.51@tcp:400:kworker.0 00000100:00080000:3.0:1782480688.741846:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480688.741873:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2369:x1869066291650944:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 47us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480688.741880:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00010000:00010000:1.0:1782480688.824380:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480688.887131:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311605760:0@lo:400:kworker.0 00000100:00100000:1.0:1782480688.887137:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311605632:0@lo:400:kworker.0 00000100:00100000:3.0:1782480688.887276:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311605888:0@lo:400:kworker.0 00000100:00100000:2.0:1782480688.887349:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4981f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311605504:0@lo:400:kworker.0 00000100:00100000:1.0:1782480688.890794:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480688.890866:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311606144:0@lo:400:kworker.0 00000100:00100000:1.0:1782480688.890902:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480688.891252:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311605632 00000100:00100000:1.0:1782480688.891261:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311605632 00000100:00100000:1.0:1782480688.891308:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782480688.891317:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311605632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480688.891387:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311605632:12345-0@lo:400:kworker.0 Request processed in 70us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480688.891394:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782480688.891449:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311605632:0@lo:400:kworker.0 00000100:00100000:1.0:1782480688.891497:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311606144 00000100:00100000:1.0:1782480688.891500:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311606144 00000100:00100000:1.0:1782480688.891537:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782480688.891558:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311606144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480688.892679:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480688.896728:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311605760 00000100:00100000:0.0:1782480688.896743:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311605760 00000100:00100000:0.0:1782480688.897125:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782480688.897138:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311605760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480688.897298:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311605760:12345-0@lo:400:kworker.0 Request processed in 163us (4629us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480688.897334:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782480688.897385:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311605760:0@lo:400:kworker.0 00000100:00080000:0.0:1782480688.897437:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782480688.897442:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782480688.897560:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480688.897692:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311605888 00000100:00100000:0.0:1782480688.897697:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311605888 00000100:00100000:0.0:1782480688.897732:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782480688.897739:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311605888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480688.898118:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480688.898153:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311606016:0@lo:400:kworker.0 00000100:00100000:2.0:1782480688.898187:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480688.898351:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311605504 00000100:00100000:3.0:1782480688.898364:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311605504 00000100:00100000:3.0:1782480688.898390:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1782480688.898397:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d59946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311605504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480688.898435:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d59946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311605504:12345-0@lo:400:kworker.0 Request processed in 39us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480688.898442:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1782480688.898488:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311606016 00000100:00100000:3.0:1782480688.898492:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311606016 00000100:00100000:3.0:1782480688.898518:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782480688.898525:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311606016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480688.898556:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311606016:12345-0@lo:400:kworker.0 Request processed in 32us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480688.898562:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782480688.900207:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311606144:12345-0@lo:400:kworker.0 Request processed in 8642us (9297us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480688.900220:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1782480688.900315:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48571c00 x1869066311606144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480688.900338:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311606144:0@lo:400:kworker.0 00000100:00080000:1.0:1782480688.900386:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782480688.900391:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480688.905856:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311605888:12345-0@lo:400:kworker.0 Request processed in 8107us (8285us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480688.906357:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4981f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311605504:0@lo:400:kworker.0 00000100:00100000:2.0:1782480688.906382:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311606016:0@lo:400:kworker.0 00000100:00100000:0.0:1782480688.906674:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1782480688.907124:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48572d80 x1869066311605888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480688.907138:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311605888:0@lo:400:kworker.0 00000100:00100000:0.0:1782480689.401278:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311606272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480689.402026:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480689.402254:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311606272 00000100:00100000:2.0:1782480689.402263:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311606272 00000100:00100000:2.0:1782480689.402321:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782480689.402331:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311606272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782480689.402376:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480689.402429:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311606272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480689.402436:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1782480689.402579:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48572d80 x1869066311606272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480689.402598:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311606272:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782480689.850881:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480690.870930:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480690.935649:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480690.935674:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311606400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480690.935767:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480690.936252:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311606400 00000100:00100000:2.0:1782480690.936260:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311606400 00000100:00100000:2.0:1782480690.936330:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782480690.936339:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311606400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782480690.936373:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480690.936420:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311606400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480690.936426:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1782480690.936461:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d750fb800 x1869066311606400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480706 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480690.936480:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311606400:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782480690.936611:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782480691.895181:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480692.921608:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480693.848435:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480693.848486:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480693.848522:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291651072 00000100:00100000:0.0:1782480693.848539:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291651072 00000100:00100000:0.0:1782480693.848596:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 201 00000100:00100000:0.0:1782480693.848607:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d5a19c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2369:x1869066291651072:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480693.848686:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d5a19c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2369:x1869066291651072:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 80us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480693.848694:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 201 00000100:00100000:2.0:1782480693.849696:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291651200 00000100:00100000:2.0:1782480693.849704:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291651200 00000100:00100000:2.0:1782480693.849784:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:2.0:1782480693.849792:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2368:x1869066291651200:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480693.849845:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2368:x1869066291651200:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 53us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480693.849873:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00080000:0.0:1782480693.850178:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782480693.954888:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480694.013458:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311606528:0@lo:400:kworker.0 00000100:00100000:0.0:1782480694.013543:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480694.013593:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311607040:0@lo:400:kworker.0 00000100:00100000:0.0:1782480694.013617:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480694.013638:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782480694.013644:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311606656:0@lo:400:kworker.0 00000100:00100000:0.0:1782480694.013667:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480694.013684:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311607168:0@lo:400:kworker.0 00000100:00100000:0.0:1782480694.013706:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480694.013734:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311606784:0@lo:400:kworker.0 00000100:00100000:0.0:1782480694.013780:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480694.013799:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480694.013805:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311606912:0@lo:400:kworker.0 00000100:00100000:0.0:1782480694.013825:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480694.013859:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311606528 00000100:00100000:0.0:1782480694.013867:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311606528 00000100:00100000:0.0:1782480694.013909:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1782480694.013917:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311606528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480694.013977:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311606528:12345-0@lo:400:kworker.0 Request processed in 60us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480694.013984:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1782480694.014039:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311607040 00000100:00100000:0.0:1782480694.014044:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311607040 00000100:00100000:0.0:1782480694.014069:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311606656 00000100:00100000:0.0:1782480694.014072:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311606656 00000100:00100000:0.0:1782480694.014082:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311606784 00000100:00100000:0.0:1782480694.014084:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311606784 00000100:00100000:0.0:1782480694.014097:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782480694.014103:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311607040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480694.014134:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311607040:12345-0@lo:400:kworker.0 Request processed in 31us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480694.014139:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782480694.014151:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782480694.014156:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311606656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480694.014181:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311606656:12345-0@lo:400:kworker.0 Request processed in 25us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480694.014187:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782480694.014199:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782480694.014206:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311606784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480694.014251:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311606784:12345-0@lo:400:kworker.0 Request processed in 46us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480694.014258:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782480694.014279:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311607168 00000100:00100000:0.0:1782480694.014282:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311607168 00000100:00100000:0.0:1782480694.014308:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311606912 00000100:00100000:0.0:1782480694.014317:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311606912 00000100:00100000:0.0:1782480694.014339:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782480694.014345:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311607168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480694.014377:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311607168:12345-0@lo:400:kworker.0 Request processed in 32us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480694.014382:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782480694.014394:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782480694.014400:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311606912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480694.014425:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311606912:12345-0@lo:400:kworker.0 Request processed in 26us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480694.014431:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1782480694.014457:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782480694.014461:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782480694.014463:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782480694.014492:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d750f9c00 x1869066311606912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480694.014505:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311606912:0@lo:400:kworker.0 00000100:00100000:0.0:1782480694.014516:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311606784:0@lo:400:kworker.0 00000100:00100000:0.0:1782480694.014546:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311606656:0@lo:400:kworker.0 00010000:00080000:0.0:1782480694.014555:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d750f9500 x1869066311607168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480694.014564:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311607168:0@lo:400:kworker.0 00000100:00100000:0.0:1782480694.014571:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311606528:0@lo:400:kworker.0 00000100:00100000:0.0:1782480694.014579:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311607040:0@lo:400:kworker.0 00000100:00100000:2.0:1782480694.518986:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311607296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480694.519055:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480694.519155:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311607296 00000100:00100000:0.0:1782480694.519164:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311607296 00000100:00100000:0.0:1782480694.519226:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782480694.519235:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311607296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782480694.519420:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480694.519479:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311607296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 245us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480694.519486:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1782480694.519551:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d750f8e00 x1869066311607296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480694.519568:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311607296:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782480694.972255:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480695.995019:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480696.056882:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782480696.056906:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311607424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480696.056981:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480696.057138:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311607424 00000100:00100000:0.0:1782480696.057146:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311607424 00000100:00100000:0.0:1782480696.057230:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782480696.057240:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311607424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782480696.057280:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480696.057330:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311607424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480696.057337:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1782480696.057504:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782480696.057534:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d750fb480 x1869066311607424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480696.057552:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311607424:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782480697.015057:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480698.040019:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480698.970778:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480698.970827:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480698.971386:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291651456 00000100:00100000:1.0:1782480698.971397:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291651456 00000100:00100000:1.0:1782480698.971505:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:1.0:1782480698.971516:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2367:x1869066291651456:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480698.971605:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2367:x1869066291651456:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 92us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480698.971613:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00080000:0.0:1782480698.972803:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480698.972871:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291651328 00000100:00100000:3.0:1782480698.972879:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291651328 00000100:00100000:3.0:1782480698.972931:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 203 00000100:00100000:3.0:1782480698.972939:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2367:x1869066291651328:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480698.973047:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2367:x1869066291651328:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 108us (2306us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480698.973053:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 203 00010000:00010000:1.0:1782480699.063251:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480699.127138:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311607936:0@lo:400:kworker.0 00000100:00100000:3.0:1782480699.127181:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311607808:0@lo:400:kworker.0 00000100:00100000:0.0:1782480699.127214:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480699.127301:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311607680:0@lo:400:kworker.0 00000100:00100000:2.0:1782480699.127376:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311607552:0@lo:400:kworker.0 00000100:00100000:0.0:1782480699.130215:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311607936 00000100:00100000:0.0:1782480699.130229:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311607936 00000100:00100000:0.0:1782480699.130299:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782480699.130313:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311607936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480699.130314:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480699.130390:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311608192:0@lo:400:kworker.0 00000100:00100000:3.0:1782480699.132009:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480699.132088:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480699.132180:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311607680 00000100:00100000:1.0:1782480699.132189:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311607680 00000100:00100000:1.0:1782480699.132231:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311607808 00000100:00100000:1.0:1782480699.132234:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311607808 00000100:00100000:1.0:1782480699.132252:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782480699.132261:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311607680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480699.132341:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311607680:12345-0@lo:400:kworker.0 Request processed in 80us (2031us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480699.132348:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782480699.132364:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782480699.132369:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311607808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480699.133314:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311607936:12345-0@lo:400:kworker.0 Request processed in 3002us (6097us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480699.133339:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782480699.133362:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311608192 00000100:00100000:0.0:1782480699.133367:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311608192 00000100:00100000:0.0:1782480699.133404:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782480699.133411:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311608192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480699.133455:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311608192:12345-0@lo:400:kworker.0 Request processed in 45us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480699.133461:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1782480699.133488:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782480699.133492:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782480699.133494:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782480699.133530:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d750faa00 x1869066311607936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480699.133545:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311607936:0@lo:400:kworker.0 00000100:00100000:0.0:1782480699.133611:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311607680:0@lo:400:kworker.0 00010000:00080000:0.0:1782480699.133623:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d750fb480 x1869066311608192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480699.133632:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311608192:0@lo:400:kworker.0 00000100:00100000:1.0:1782480699.135007:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311607808:12345-0@lo:400:kworker.0 Request processed in 2631us (2996us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480699.135019:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782480699.135879:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480699.135929:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311608064:0@lo:400:kworker.0 00000100:00100000:2.0:1782480699.135970:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480699.136100:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311608064 00000100:00100000:1.0:1782480699.136109:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311608064 00000100:00100000:1.0:1782480699.136200:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782480699.136209:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311608064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480699.136259:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311608064:12345-0@lo:400:kworker.0 Request processed in 51us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480699.136265:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1782480699.137264:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480699.137330:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311608064:0@lo:400:kworker.0 00000100:00100000:0.0:1782480699.137827:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311607552 00000100:00100000:0.0:1782480699.137834:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311607552 00000100:00100000:0.0:1782480699.137890:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1782480699.137899:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311607552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480699.137980:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311607552:12345-0@lo:400:kworker.0 Request processed in 81us (2101us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480699.137987:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1782480699.138558:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311607552:0@lo:400:kworker.0 00000100:00100000:3.0:1782480699.141548:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311607808:0@lo:400:kworker.0 00000100:00100000:3.0:1782480699.643017:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311608320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480699.643092:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480699.643347:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311608320 00000100:00100000:0.0:1782480699.643356:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311608320 00000100:00100000:0.0:1782480699.643412:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782480699.643422:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311608320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782480699.643459:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480699.643518:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311608320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480699.643526:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1782480699.643962:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d750fb480 x1869066311608320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480699.643983:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311608320:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782480700.089503:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782480700.513059:0:9974:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 09:31:39 (1782480699) === 00000100:00100000:0.0:1782480701.048713:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480701.048866:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291651584 00000100:00100000:3.0:1782480701.048878:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291651584 00000100:00100000:3.0:1782480701.048934:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 205 00000100:00100000:3.0:1782480701.048944:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:8119:x1869066291651584:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782480701.048962:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480701.048978:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d821ec200/0x3dc3ebf33c023abb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f782 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480701.049008:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d821ec200/0x3dc3ebf33c023abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f782 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480701.049021:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d821ec200/0x3dc3ebf33c023abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f782 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480701.049031:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ec200, rc 0) 00000100:00100000:3.0:1782480701.049143:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+11:8119:x1869066291651584:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 200us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480701.049151:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 205 00000100:00100000:2.0:1782480701.075432:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480701.075565:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291651712 00000100:00100000:3.0:1782480701.075583:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291651712 00000100:00100000:3.0:1782480701.075640:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 206 00000100:00100000:3.0:1782480701.075650:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+11:8119:x1869066291651712:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782480701.075970:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+11:8119:x1869066291651712:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 320us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480701.075988:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 206 00000100:00100000:2.0:1782480701.082847:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480701.082934:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291651840 00000100:00100000:0.0:1782480701.082944:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291651840 00000100:00100000:0.0:1782480701.082995:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 207 00000100:00100000:0.0:1782480701.083006:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+11:8119:x1869066291651840:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782480701.083252:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+11:8119:x1869066291651840:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 246us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480701.083260:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 207 00000100:00100000:1.0:1782480701.098300:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480701.098739:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291651968 00000100:00100000:0.0:1782480701.098775:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291651968 00000100:00100000:0.0:1782480701.098841:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 208 00000100:00100000:0.0:1782480701.098851:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+11:8124:x1869066291651968:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782480701.099135:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+11:8124:x1869066291651968:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 284us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480701.099143:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 208 00010000:00010000:1.0:1782480701.111019:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480701.123570:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480701.123770:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291652096 00000100:00100000:3.0:1782480701.123781:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291652096 00000100:00100000:3.0:1782480701.123841:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 209 00000100:00100000:3.0:1782480701.123851:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+11:8124:x1869066291652096:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782480701.124140:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+11:8124:x1869066291652096:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 289us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480701.124148:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 209 00000100:00100000:3.0:1782480701.131065:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480701.131272:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291652224 00000100:00100000:2.0:1782480701.131282:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291652224 00000100:00100000:2.0:1782480701.131334:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 210 00000100:00100000:2.0:1782480701.131355:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+11:8119:x1869066291652224:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782480701.131373:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480701.131391:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d6873ce00/0x3dc3ebf33c023ac2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f7ac expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480701.131418:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d6873ce00/0x3dc3ebf33c023ac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7ac expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480701.131443:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d6873ce00/0x3dc3ebf33c023ac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7ac expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480701.131452:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6873ce00, rc 0) 00000100:00100000:2.0:1782480701.131510:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:8119:x1869066291652224:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 168us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480701.131517:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 210 00000100:00100000:1.0:1782480701.138137:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480701.138241:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291652352 00000100:00100000:0.0:1782480701.138250:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291652352 00000100:00100000:0.0:1782480701.138308:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 211 00000100:00100000:0.0:1782480701.138318:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:8119:x1869066291652352:12345-192.168.204.51@tcp:256:mount.lustre.0 20000000:01000000:0.0:1782480701.138368:0:5799:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1782480701.138385:0:5799:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782480701.138389:0:5799:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1782480701.138392:0:5799:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1782480701.138395:0:5799:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1782480701.139995:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:8119:x1869066291652352:12345-192.168.204.51@tcp:256:mount.lustre.0 Request processed in 1671us (1861us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480701.140006:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 211 00000100:00100000:3.0:1782480701.144003:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480701.144125:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291652480 00000100:00100000:2.0:1782480701.144135:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291652480 00000100:00100000:2.0:1782480701.144197:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 212 00000100:00100000:2.0:1782480701.144209:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:8119:x1869066291652480:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782480701.144227:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480701.144245:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d6873c600/0x3dc3ebf33c023ac9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f7b3 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480701.144274:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d6873c600/0x3dc3ebf33c023ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7b3 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480701.144286:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d6873c600/0x3dc3ebf33c023ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7b3 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480701.144296:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6873c600, rc 0) 00000100:00100000:2.0:1782480701.144366:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:8119:x1869066291652480:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 159us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480701.144373:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 212 00000100:00100000:1.0:1782480701.146486:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480701.146583:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291652608 00000100:00100000:0.0:1782480701.146591:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291652608 00000100:00100000:0.0:1782480701.146642:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 213 00000100:00100000:0.0:1782480701.146652:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:8119:x1869066291652608:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782480701.146951:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:8119:x1869066291652608:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 300us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480701.146959:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 213 00000100:00100000:1.0:1782480701.149179:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480701.149324:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291652736 00000100:00100000:0.0:1782480701.149332:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291652736 00000100:00100000:0.0:1782480701.149422:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 214 00000100:00100000:0.0:1782480701.149431:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:8119:x1869066291652736:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782480701.149733:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:8119:x1869066291652736:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 302us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480701.149741:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 214 00000100:00100000:3.0:1782480701.153775:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480701.157014:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291652864 00000100:00100000:0.0:1782480701.157030:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291652864 00000100:00100000:0.0:1782480701.157109:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 215 00000100:00100000:0.0:1782480701.157118:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:8128:x1869066291652864:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782480701.158107:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:8128:x1869066291652864:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 985us (4361us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480701.158118:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 215 00000100:00100000:1.0:1782480701.165005:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480701.165150:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291652992 00000100:00100000:3.0:1782480701.165171:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291652992 00000100:00100000:3.0:1782480701.165241:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 216 00000100:00100000:3.0:1782480701.165252:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:8128:x1869066291652992:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782480701.166001:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:8128:x1869066291652992:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 287us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480701.166013:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 216 00000100:00100000:1.0:1782480701.170482:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480701.170822:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291653248 00000100:00100000:0.0:1782480701.170832:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291653248 00000100:00100000:0.0:1782480701.170920:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:0.0:1782480701.170930:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2369:x1869066291653248:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480701.171010:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2369:x1869066291653248:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 82us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480701.171017:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00080000:2.0:1782480701.175704:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480701.176121:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311608448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480701.176192:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480701.177358:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311608448 00000100:00100000:0.0:1782480701.177368:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311608448 00000100:00100000:0.0:1782480701.177443:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782480701.177452:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311608448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782480701.177485:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480701.177556:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311608448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480701.177563:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1782480701.177728:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782480701.177923:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d750fad80 x1869066311608448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480701.177944:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311608448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480701.182926:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480701.183041:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291653120 00000100:00100000:1.0:1782480701.183051:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291653120 00000100:00100000:1.0:1782480701.183112:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:1.0:1782480701.183120:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2365:x1869066291653120:12345-192.168.204.51@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782480701.183155:0:5809:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 210e3ff4-fa06-469c-afa9-3e2abcd77331@192.168.204.51@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:1.0:1782480701.183220:0:5809:0:(genops.c:1406:class_connect()) connect: client 210e3ff4-fa06-469c-afa9-3e2abcd77331, cookie 0x3dc3ebf33c023ad0 00000004:00100000:1.0:1782480701.183254:0:5809:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1782480701.183567:0:5809:0:(import.c:65:import_set_state_nolock()) ffff9b6d74e80800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782480701.183643:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+6:2365:x1869066291653120:12345-192.168.204.51@tcp:38:mount.lustre.0 Request processed in 522us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480701.183650:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:1.0:1782480701.192510:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480701.192583:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480701.192730:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291653504 00000100:00100000:2.0:1782480701.192739:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291653504 00000100:00100000:2.0:1782480701.192822:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291653376 00000100:00100000:2.0:1782480701.192825:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291653376 00000100:00100000:2.0:1782480701.192841:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:2.0:1782480701.192850:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+7:8119:x1869066291653504:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782480701.192906:0:5809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1782480701.192985:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+7:8119:x1869066291653504:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 135us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480701.192993:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:2.0:1782480701.193011:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:2.0:1782480701.193017:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+6:0:x1869066291653376:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782480701.193029:0:5809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1782480701.193050:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+6:0:x1869066291653376:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 33us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480701.193057:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00080000:3.0:1782480701.193719:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480701.195863:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480701.196004:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291653632 00000100:00100000:1.0:1782480701.196013:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291653632 00000100:00100000:1.0:1782480701.196064:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:1.0:1782480701.196074:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+6:8119:x1869066291653632:12345-192.168.204.51@tcp:40:mount.lustre.0 00000100:00100000:1.0:1782480701.196169:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+6:8119:x1869066291653632:12345-192.168.204.51@tcp:40:mount.lustre.0 Request processed in 96us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480701.196177:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:2.0:1782480701.203289:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480701.203335:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480701.203483:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291653760 00000100:00100000:1.0:1782480701.203493:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291653760 00000100:00100000:1.0:1782480701.203535:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291653888 00000100:00100000:2.0:1782480701.203639:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:2.0:1782480701.203648:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2365:x1869066291653760:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782480701.203681:0:6602:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 210e3ff4-fa06-469c-afa9-3e2abcd77331@192.168.204.51@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:2.0:1782480701.203717:0:6602:0:(genops.c:1406:class_connect()) connect: client 210e3ff4-fa06-469c-afa9-3e2abcd77331, cookie 0x3dc3ebf33c023ad7 00002000:00100000:2.0:1782480701.203731:0:6602:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 210e3ff4-fa06-469c-afa9-3e2abcd77331/ffff9b6d47348800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211365f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782480701.203795:0:6602:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782480701.204074:0:6602:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782480701.204116:0:6602:0:(import.c:65:import_set_state_nolock()) ffff9b6d4734d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782480701.204178:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:210e3ff4-fa06-469c-afa9-3e2abcd77331+6:2365:x1869066291653760:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 529us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480701.204186:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:1.0:1782480701.204549:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291653888 00000100:00100000:1.0:1782480701.204584:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:1.0:1782480701.204591:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2365:x1869066291653888:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782480701.204611:0:6605:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 210e3ff4-fa06-469c-afa9-3e2abcd77331@192.168.204.51@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:1.0:1782480701.204633:0:6605:0:(genops.c:1406:class_connect()) connect: client 210e3ff4-fa06-469c-afa9-3e2abcd77331, cookie 0x3dc3ebf33c023ade 00002000:00100000:1.0:1782480701.204640:0:6605:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 210e3ff4-fa06-469c-afa9-3e2abcd77331/ffff9b6d74e82800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211365f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782480701.204656:0:6605:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782480701.204812:0:6605:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782480701.204828:0:6605:0:(import.c:65:import_set_state_nolock()) ffff9b6d74e85800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782480701.204859:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+6:2365:x1869066291653888:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 268us (1523us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480701.204867:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:2.0:1782480701.212434:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480701.216097:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291654016 00000100:00100000:3.0:1782480701.216113:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291654016 00000100:00100000:2.0:1782480701.220314:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:2.0:1782480701.220329:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:210e3ff4-fa06-469c-afa9-3e2abcd77331+6:8119:x1869066291654016:12345-192.168.204.51@tcp:33:mount.lustre.0 00000004:00200000:2.0:1782480701.220577:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1782480701.220716:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:210e3ff4-fa06-469c-afa9-3e2abcd77331+6:8119:x1869066291654016:12345-192.168.204.51@tcp:33:mount.lustre.0 Request processed in 390us (8292us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480701.220724:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00010000:00010000:2.0:1782480702.136801:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480703.161909:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782480703.284454:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 210e3ff4-fa06-469c-afa9-3e2abcd77331 00000001:00100000:2.0:1782480703.303621:0:7497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 210e3ff4-fa06-469c-afa9-3e2abcd77331 00010000:00010000:1.0:1782480704.183860:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480704.261127:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f12ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311608704:0@lo:400:kworker.0 00000100:00100000:1.0:1782480704.261212:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480704.261277:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311609216:0@lo:400:kworker.0 00000100:00100000:1.0:1782480704.261317:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480704.261346:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782480704.261353:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f12a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311608576:0@lo:400:kworker.0 00000100:00100000:1.0:1782480704.261382:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480704.261415:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066311609088:0@lo:400:kworker.0 00000100:00100000:1.0:1782480704.261437:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480704.261462:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311608960:0@lo:400:kworker.0 00000100:00100000:1.0:1782480704.261485:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480704.261503:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782480704.261509:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1869066311608832:0@lo:400:kworker.0 00000100:00100000:1.0:1782480704.261531:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480704.261558:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311608704 00000100:00100000:1.0:1782480704.261565:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311608704 00000100:00100000:1.0:1782480704.261601:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311609088 00000100:00100000:1.0:1782480704.261604:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311609088 00000100:00100000:1.0:1782480704.261627:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311608832 00000100:00100000:1.0:1782480704.261630:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311608832 00000100:00100000:1.0:1782480704.261663:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782480704.261672:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311608704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480704.261723:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311608704:12345-0@lo:400:kworker.0 Request processed in 53us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480704.261731:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782480704.261774:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782480704.261782:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066311609088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480704.261810:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066311609088:12345-0@lo:400:kworker.0 Request processed in 30us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480704.261816:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782480704.261828:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782480704.261834:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869066311608832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480704.261864:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869066311608832:12345-0@lo:400:kworker.0 Request processed in 30us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480704.261870:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782480704.261889:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311609216 00000100:00100000:1.0:1782480704.261893:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311609216 00000100:00100000:1.0:1782480704.261919:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311608960 00000100:00100000:1.0:1782480704.261922:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311608960 00000100:00100000:1.0:1782480704.261941:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782480704.261948:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311609216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480704.261977:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311609216:12345-0@lo:400:kworker.0 Request processed in 30us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480704.261984:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782480704.261995:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782480704.262001:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311608960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480704.262054:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f128a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311608960:12345-0@lo:400:kworker.0 Request processed in 53us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480704.262061:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1782480704.262081:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782480704.262084:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782480704.262087:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480704.262117:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1869066311608832:0@lo:400:kworker.0 00010000:00080000:1.0:1782480704.262130:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f128e00 x1869066311608960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480704.262140:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311608960:0@lo:400:kworker.0 00000100:00100000:1.0:1782480704.262172:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066311609088:0@lo:400:kworker.0 00000100:00100000:1.0:1782480704.262182:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f12ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311608704:0@lo:400:kworker.0 00010000:00080000:1.0:1782480704.262192:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f128000 x1869066311609216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480704.262201:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311609216:0@lo:400:kworker.0 00000100:00100000:2.0:1782480704.262870:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311608576 00000100:00100000:2.0:1782480704.262877:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311608576 00000100:00100000:2.0:1782480704.262909:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1782480704.262917:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3316:x1869066311608576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480704.262969:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3316:x1869066311608576:12345-0@lo:400:kworker.0 Request processed in 53us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480704.262975:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1782480704.263032:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f12a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311608576:0@lo:400:kworker.0 00000100:00100000:2.0:1782480704.765650:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782480704.765673:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311609344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480704.765795:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480704.766182:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311609344 00000100:00100000:1.0:1782480704.766191:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311609344 00000100:00100000:1.0:1782480704.766257:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782480704.766267:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311609344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480704.766305:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480704.766365:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311609344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480704.766372:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1782480704.767245:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f128000 x1869066311609344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480704.767267:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311609344:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782480705.216186:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782480705.381956:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 210e3ff4-fa06-469c-afa9-3e2abcd77331 00010000:00010000:1.0:1782480706.230989:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480706.295424:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311609472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480706.295498:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480706.295641:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311609472 00000100:00100000:1.0:1782480706.295649:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311609472 00000100:00100000:1.0:1782480706.295738:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782480706.295769:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311609472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782480706.295803:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480706.295845:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311609472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480706.295853:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1782480706.296121:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782480706.296150:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d750faa00 x1869066311609472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480706.296169:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311609472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480706.665634:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480706.665676:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480706.665709:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480706.665742:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480706.665817:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480706.665901:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291654400 00000100:00100000:1.0:1782480706.665911:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291654400 00000100:00100000:1.0:1782480706.665969:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291654272 00000100:00100000:1.0:1782480706.665984:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291654272 00000100:00100000:1.0:1782480706.666004:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:1.0:1782480706.666012:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291654400:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480706.666083:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291654400:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 72us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480706.666091:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:1.0:1782480706.666106:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:1.0:1782480706.666111:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2366:x1869066291654272:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480706.666128:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2366:x1869066291654272:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 18us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480706.666134:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:1.0:1782480706.666152:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291654656 00000100:00100000:1.0:1782480706.666154:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291654656 00000100:00100000:1.0:1782480706.666173:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291654528 00000100:00100000:1.0:1782480706.666175:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291654528 00000100:00100000:1.0:1782480706.666189:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:1.0:1782480706.666201:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291654656:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480706.666223:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291654656:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 23us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480706.666229:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:1.0:1782480706.666244:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:1.0:1782480706.666249:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291654528:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480706.666282:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291654528:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 33us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480706.666288:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00080000:3.0:1782480706.666530:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782480706.666534:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782480706.666537:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480706.666812:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291654144 00000100:00100000:0.0:1782480706.666818:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291654144 00000100:00100000:0.0:1782480706.666850:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 218 00000100:00100000:0.0:1782480706.666857:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2366:x1869066291654144:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480706.666887:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2366:x1869066291654144:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 31us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480706.666904:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 218 00010000:00010000:1.0:1782480707.264890:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782480707.858683:0:10172:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1782480708.305596:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480709.305365:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480709.367026:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311609728:0@lo:400:kworker.0 00000100:00100000:2.0:1782480709.367027:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f1c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311609984:0@lo:400:kworker.0 00000100:00100000:1.0:1782480709.367121:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7591f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311609600:0@lo:400:kworker.0 00000100:00100000:3.0:1782480709.368963:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480709.368998:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480709.369033:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311610240:0@lo:400:kworker.0 00000100:00100000:3.0:1782480709.369065:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480709.369107:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f1c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311609856:0@lo:400:kworker.0 00000100:00100000:3.0:1782480709.369129:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480709.369157:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311609984 00000100:00100000:3.0:1782480709.369164:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311609984 00000100:00100000:3.0:1782480709.369211:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311610240 00000100:00100000:3.0:1782480709.369214:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311610240 00000100:00100000:3.0:1782480709.369238:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782480709.369247:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311609984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480709.369302:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311609984:12345-0@lo:400:kworker.0 Request processed in 56us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480709.369310:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782480709.369323:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782480709.369329:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311610240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480709.369359:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311610240:12345-0@lo:400:kworker.0 Request processed in 30us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480709.369365:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782480709.369383:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311609728 00000100:00100000:3.0:1782480709.369386:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311609728 00000100:00100000:3.0:1782480709.369408:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311609856 00000100:00100000:3.0:1782480709.369418:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311609856 00000100:00100000:3.0:1782480709.369435:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782480709.369440:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311609728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480709.369469:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311609728:12345-0@lo:400:kworker.0 Request processed in 29us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480709.369474:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782480709.369483:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782480709.369488:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311609856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480709.369517:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311609856:12345-0@lo:400:kworker.0 Request processed in 29us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480709.369524:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1782480709.369540:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782480709.369545:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782480709.369546:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480709.369576:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f1c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311609728:0@lo:400:kworker.0 00010000:00080000:3.0:1782480709.369588:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d48574a80 x1869066311610240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480709.369597:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311610240:0@lo:400:kworker.0 00000100:00100000:3.0:1782480709.369624:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f1c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311609856:0@lo:400:kworker.0 00010000:00080000:3.0:1782480709.369641:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f1c2a00 x1869066311609984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480709.369652:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f1c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311609984:0@lo:400:kworker.0 00000100:00100000:1.0:1782480709.370623:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480709.370669:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311610112:0@lo:400:kworker.0 00000100:00100000:1.0:1782480709.370702:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480709.370846:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311609600 00000100:00100000:0.0:1782480709.370851:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311609600 00000100:00100000:0.0:1782480709.370889:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1782480709.370897:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311609600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480709.370953:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311609600:12345-0@lo:400:kworker.0 Request processed in 57us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480709.370960:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1782480709.371116:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7591f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311609600:0@lo:400:kworker.0 00000100:00100000:2.0:1782480709.371189:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311610112 00000100:00100000:2.0:1782480709.371194:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311610112 00000100:00080000:0.0:1782480709.371303:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480709.371326:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782480709.371337:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311610112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480709.371459:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311610112:12345-0@lo:400:kworker.0 Request processed in 124us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480709.371466:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782480709.371553:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f1c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311610112:0@lo:400:kworker.0 00000100:00100000:3.0:1782480709.884001:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311610368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480709.884078:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480709.884353:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311610368 00000100:00100000:1.0:1782480709.884363:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311610368 00000100:00100000:1.0:1782480709.884410:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782480709.884419:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311610368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480709.884452:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480709.892237:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311610368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7810us (8150us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480709.892251:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1782480709.898833:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f129500 x1869066311610368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480725 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480709.898861:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311610368:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782480710.327377:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480711.356687:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480711.416294:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782480711.416314:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7591dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311610496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480711.416375:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480711.416442:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311610496 00000100:00100000:3.0:1782480711.416449:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311610496 00000100:00100000:3.0:1782480711.416502:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782480711.416512:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311610496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480711.416547:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480711.416600:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311610496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480711.416607:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1782480711.416643:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7591dc00 x1869066311610496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480711.416661:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7591dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311610496:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782480711.416686:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480711.770975:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480711.771016:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480711.771045:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480711.771065:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480711.771089:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480711.771118:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291655040 00000100:00100000:3.0:1782480711.771127:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291655040 00000100:00100000:3.0:1782480711.771360:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291654912 00000100:00100000:3.0:1782480711.771377:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291654912 00000100:00100000:3.0:1782480711.771406:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:3.0:1782480711.771416:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2368:x1869066291655040:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480711.771488:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2368:x1869066291655040:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 73us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480711.771496:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:3.0:1782480711.771513:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:3.0:1782480711.771521:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2368:x1869066291654912:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480711.771548:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2368:x1869066291654912:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 28us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480711.771555:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:3.0:1782480711.771574:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291655296 00000100:00100000:3.0:1782480711.771578:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291655296 00000100:00100000:3.0:1782480711.771603:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291655168 00000100:00100000:3.0:1782480711.771606:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291655168 00000100:00100000:3.0:1782480711.771698:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:3.0:1782480711.771710:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2368:x1869066291655296:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480711.771739:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2368:x1869066291655296:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 33us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480711.771768:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:3.0:1782480711.771782:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:3.0:1782480711.771788:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2368:x1869066291655168:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480711.771814:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2368:x1869066291655168:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480711.771821:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00080000:3.0:1782480711.772038:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782480711.772042:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782480711.772045:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480711.772281:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291654784 00000100:00100000:0.0:1782480711.772286:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291654784 00000100:00100000:0.0:1782480711.772324:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 220 00000100:00100000:0.0:1782480711.772332:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2368:x1869066291654784:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480711.772363:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2368:x1869066291654784:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 33us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480711.772369:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 220 00010000:00010000:0.0:1782480712.375230:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480713.401726:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480714.431206:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480714.498206:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311610880:0@lo:400:kworker.0 00000100:00100000:1.0:1782480714.498274:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480714.498344:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311610880 00000100:00100000:1.0:1782480714.498351:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311610880 00000100:00100000:1.0:1782480714.498405:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782480714.498416:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311610880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480714.498467:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311610880:12345-0@lo:400:kworker.0 Request processed in 54us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480714.498473:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1782480714.498493:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480714.498523:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311610880:0@lo:400:kworker.0 00000100:00100000:1.0:1782480714.498554:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782480714.498560:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311611008:0@lo:400:kworker.0 00000100:00100000:1.0:1782480714.498583:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480714.498620:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311611008 00000100:00100000:1.0:1782480714.498624:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311611008 00000100:00100000:1.0:1782480714.498654:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782480714.498660:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311611008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480714.498693:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311611008:12345-0@lo:400:kworker.0 Request processed in 34us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480714.498700:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1782480714.498713:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782480714.498731:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f128380 x1869066311611008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480714.498741:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311611008:0@lo:400:kworker.0 00000100:00100000:2.0:1782480714.498898:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311610752:0@lo:400:kworker.0 00000100:00100000:2.0:1782480714.498928:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480714.498956:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f12b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311611264:0@lo:400:kworker.0 00000100:00100000:2.0:1782480714.498980:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480714.499002:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782480714.499008:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311610624:0@lo:400:kworker.0 00000100:00100000:3.0:1782480714.499013:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311610752 00000100:00100000:3.0:1782480714.499018:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311610752 00000100:00100000:2.0:1782480714.499033:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480714.499043:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782480714.499049:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311610752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480714.499052:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066311611136:0@lo:400:kworker.0 00000100:00100000:2.0:1782480714.499071:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480714.499091:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311610752:0@lo:400:kworker.0 00000100:00100000:2.0:1782480714.499112:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311611264 00000100:00100000:2.0:1782480714.499116:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311611264 00000100:00100000:3.0:1782480714.499145:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311610752:12345-0@lo:400:kworker.0 Request processed in 96us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480714.499146:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782480714.499152:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782480714.499152:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311611264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480714.499184:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311611264:12345-0@lo:400:kworker.0 Request processed in 32us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480714.499190:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782480714.499230:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311611136 00000100:00100000:3.0:1782480714.499233:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311611136 00000100:00100000:3.0:1782480714.499311:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1782480714.499317:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066311611136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480714.499324:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311610624 00000100:00100000:2.0:1782480714.499328:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311610624 00000100:00100000:3.0:1782480714.499347:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066311611136:12345-0@lo:400:kworker.0 Request processed in 30us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480714.499351:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1782480714.499353:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782480714.499356:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3316:x1869066311610624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480714.499382:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3316:x1869066311610624:12345-0@lo:400:kworker.0 Request processed in 26us (348us total) trans 0 rc 0/0 00000100:00080000:3.0:1782480714.499385:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782480714.499388:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782480714.499388:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1782480714.499408:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311610624:0@lo:400:kworker.0 00000100:00100000:3.0:1782480714.499418:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066311611136:0@lo:400:kworker.0 00010000:00080000:3.0:1782480714.499428:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f12b800 x1869066311611264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480714.499589:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f12b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311611264:0@lo:400:kworker.0 00000100:00100000:3.0:1782480715.000968:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782480715.000997:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f12b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311611392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480715.001093:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480715.001959:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311611392 00000100:00100000:1.0:1782480715.001968:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311611392 00000100:00100000:1.0:1782480715.002030:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782480715.002040:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311611392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480715.002077:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480715.002144:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311611392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480715.002151:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1782480715.002255:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f12b100 x1869066311611392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480715.002273:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f12b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311611392:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782480715.448300:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480716.471057:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480716.539596:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480716.539621:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311611520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480716.539695:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480716.539788:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311611520 00000100:00100000:0.0:1782480716.539796:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311611520 00000100:00100000:0.0:1782480716.539862:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1782480716.539870:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311611520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782480716.539902:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480716.539943:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311611520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480716.539950:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1782480716.540663:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782480716.540700:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d750fb800 x1869066311611520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480732 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480716.540724:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311611520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480716.886124:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480716.886302:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480716.886344:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480716.886370:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480716.886394:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480716.886423:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291655424 00000100:00100000:3.0:1782480716.886433:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291655424 00000100:00100000:0.0:1782480716.886458:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291655552 00000100:00100000:0.0:1782480716.886462:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291655552 00000100:00100000:3.0:1782480716.886483:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 222 00000100:00100000:3.0:1782480716.886494:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2366:x1869066291655424:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480716.886497:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291655680 00000100:00100000:0.0:1782480716.886500:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291655680 00000100:00100000:0.0:1782480716.886513:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:0.0:1782480716.886519:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2366:x1869066291655552:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480716.886563:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2366:x1869066291655424:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 71us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480716.886570:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 222 00000100:00100000:1.0:1782480716.886591:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291655808 00000100:00100000:1.0:1782480716.886595:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291655808 00000100:00100000:3.0:1782480716.886603:0:5808:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1782480716.886609:0:5808:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1782480716.886623:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291655936 00000100:00100000:1.0:1782480716.886625:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291655936 00000100:00100000:3.0:1782480716.886627:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:3.0:1782480716.886633:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291655808:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480716.886644:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:1.0:1782480716.886650:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291655936:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480716.890396:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2366:x1869066291655552:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 3860us (4267us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480716.890413:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:0.0:1782480716.890455:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00100000:0.0:1782480716.890469:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291655680:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480716.890525:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291655680:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 61us (4153us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480716.890532:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00080000:0.0:1782480716.890558:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782480716.890578:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782480716.890581:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480716.891717:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291655808:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 5077us (5409us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480716.891786:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:1.0:1782480716.891873:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291655936:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 5221us (5476us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480716.891882:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00010000:00010000:3.0:1782480717.505862:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480718.519226:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480719.543197:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480719.614349:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311611648:0@lo:400:kworker.0 00000100:00100000:1.0:1782480719.614422:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480719.614471:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782480719.614477:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311611776:0@lo:400:kworker.0 00000100:00100000:1.0:1782480719.614502:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480719.614534:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311611776 00000100:00100000:1.0:1782480719.614541:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311611776 00000100:00100000:1.0:1782480719.614584:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782480719.614592:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311611776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480719.614651:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311611776:12345-0@lo:400:kworker.0 Request processed in 58us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480719.614657:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782480719.614698:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311611776:0@lo:400:kworker.0 00000100:00100000:2.0:1782480719.614829:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311612288:0@lo:400:kworker.0 00000100:00100000:2.0:1782480719.614861:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480719.614880:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782480719.614886:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066311612160:0@lo:400:kworker.0 00000100:00100000:2.0:1782480719.614906:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480719.614930:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311611648 00000100:00100000:2.0:1782480719.614934:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311611648 00000100:00100000:2.0:1782480719.614960:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1782480719.614967:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311611648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480719.615061:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311611648:12345-0@lo:400:kworker.0 Request processed in 93us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480719.615067:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1782480719.615332:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311611904:0@lo:400:kworker.0 00000100:00100000:2.0:1782480719.615360:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480719.615376:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782480719.615382:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311612032:0@lo:400:kworker.0 00000100:00100000:2.0:1782480719.615401:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480719.615425:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311612288 00000100:00100000:2.0:1782480719.615429:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311612288 00000100:00100000:2.0:1782480719.615461:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311612032 00000100:00100000:2.0:1782480719.615463:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311612032 00000100:00100000:2.0:1782480719.615481:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782480719.615486:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311612288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480719.615518:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311612288:12345-0@lo:400:kworker.0 Request processed in 32us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480719.615536:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782480719.615546:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782480719.615551:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311612032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480719.615582:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311612032:12345-0@lo:400:kworker.0 Request processed in 31us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480719.615587:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782480719.615602:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311612160 00000100:00100000:2.0:1782480719.615605:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311612160 00000100:00100000:2.0:1782480719.615624:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311611904 00000100:00100000:2.0:1782480719.615626:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311611904 00000100:00100000:2.0:1782480719.615644:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782480719.615649:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066311612160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480719.615674:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066311612160:12345-0@lo:400:kworker.0 Request processed in 25us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480719.615680:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782480719.615689:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782480719.615694:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311611904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480719.615714:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311611904:12345-0@lo:400:kworker.0 Request processed in 21us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480719.615732:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1782480719.615774:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782480719.615779:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782480719.615781:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782480719.615805:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066311612160:0@lo:400:kworker.0 00010000:00080000:2.0:1782480719.615815:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f2d4380 x1869066311612288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480719.615836:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311612288:0@lo:400:kworker.0 00010000:00080000:2.0:1782480719.615867:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f2d4a80 x1869066311612032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480719.615876:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311612032:0@lo:400:kworker.0 00000100:00100000:2.0:1782480719.615886:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311611904:0@lo:400:kworker.0 00000100:00100000:1.0:1782480719.616239:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311611648:0@lo:400:kworker.0 00000100:00100000:2.0:1782480720.123642:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311612416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480720.123724:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480720.128354:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311612416 00000100:00100000:1.0:1782480720.128370:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311612416 00000100:00100000:1.0:1782480720.128429:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782480720.128439:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311612416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480720.128476:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480720.128564:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311612416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (4839us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480720.128571:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1782480720.130400:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f2d6300 x1869066311612416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480720.130433:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311612416:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782480720.567374:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480721.594484:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480721.659272:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311612544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480721.659343:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480721.659425:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311612544 00000100:00100000:2.0:1782480721.659433:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311612544 00000100:00100000:2.0:1782480721.659485:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782480721.659494:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311612544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782480721.659529:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480721.659570:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311612544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480721.659576:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1782480721.659595:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782480721.659623:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f2d4380 x1869066311612544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480737 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480721.659643:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311612544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480722.012130:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480722.012197:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480722.012218:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480722.012239:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480722.012492:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480722.012527:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291656064 00000100:00100000:2.0:1782480722.012536:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291656064 00000100:00100000:2.0:1782480722.012584:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 224 00000100:00100000:2.0:1782480722.012593:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d68bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2369:x1869066291656064:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480722.012733:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291656448 00000100:00100000:3.0:1782480722.012737:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291656448 00000100:00100000:3.0:1782480722.012789:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291656576 00000100:00100000:3.0:1782480722.012792:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291656576 00000100:00100000:3.0:1782480722.012811:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:3.0:1782480722.012819:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2365:x1869066291656448:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:3.0:1782480722.012838:0:6605:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c023ad7 00000100:00080000:3.0:1782480722.012846:0:6605:0:(import.c:65:import_set_state_nolock()) ffff9b6d4734d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782480722.012879:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1782480722.013199:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+2:2365:x1869066291656448:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 380us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480722.013208:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:3.0:1782480722.013224:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:3.0:1782480722.013231:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2365:x1869066291656576:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:3.0:1782480722.013243:0:6605:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c023ade 00000100:00080000:3.0:1782480722.013370:0:6605:0:(import.c:65:import_set_state_nolock()) ffff9b6d74e85800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782480722.013393:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1782480722.013575:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+2:2365:x1869066291656576:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 344us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480722.013583:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00010000:00010000:3.0:1782480722.013782:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480722.013865:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d68bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2369:x1869066291656064:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 1271us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480722.013874:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 224 00000100:00100000:2.0:1782480722.013913:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291656320 00000100:00100000:2.0:1782480722.013918:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291656320 00000100:00100000:2.0:1782480722.013948:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291656192 00000100:00100000:2.0:1782480722.013952:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291656192 00000100:00100000:2.0:1782480722.013974:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:2.0:1782480722.013981:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2369:x1869066291656320:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480722.014014:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2369:x1869066291656320:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 34us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480722.014021:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:2.0:1782480722.014033:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:2.0:1782480722.014039:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2369:x1869066291656192:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480722.014062:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2369:x1869066291656192:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 24us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480722.014067:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00080000:2.0:1782480722.014094:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782480722.014110:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782480722.014112:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782480722.014129:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480722.615416:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480723.640849:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782480723.743588:0:7497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 210e3ff4-fa06-469c-afa9-3e2abcd77331 00000020:00000080:3.0:1782480723.743597:0:7497:0:(genops.c:906:class_export_put()) final put ffff9b6d74e82800/210e3ff4-fa06-469c-afa9-3e2abcd77331 00000020:00000080:3.0:1782480723.743620:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d74e82800/210e3ff4-fa06-469c-afa9-3e2abcd77331 for lustre-OST0001 00000020:00000080:3.0:1782480723.743670:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6d74e85800 for lustre-OST0001 00010000:00010000:2.0:1782480724.667785:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480724.727221:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311612800:0@lo:400:kworker.0 00000100:00100000:2.0:1782480724.727293:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480724.727343:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311613312:0@lo:400:kworker.0 00000100:00100000:2.0:1782480724.727369:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480724.727590:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311612672:0@lo:400:kworker.0 00000100:00100000:1.0:1782480724.727638:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480724.727714:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311612672 00000100:00100000:0.0:1782480724.727721:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311612672 00000100:00100000:0.0:1782480724.727812:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1782480724.727821:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d68bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311612672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480724.727873:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d68bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311612672:12345-0@lo:400:kworker.0 Request processed in 54us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480724.728220:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1782480724.728468:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311613056:0@lo:400:kworker.0 00000100:00100000:2.0:1782480724.728556:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480724.728639:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311612800 00000100:00100000:2.0:1782480724.728646:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311612800 00000100:00100000:2.0:1782480724.728681:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782480724.728688:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311612800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480724.728729:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311612800:12345-0@lo:400:kworker.0 Request processed in 42us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480724.728735:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782480724.728805:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311612800:0@lo:400:kworker.0 00000100:00100000:2.0:1782480724.728846:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311612928:0@lo:400:kworker.0 00000100:00100000:2.0:1782480724.728870:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480724.729658:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311612928 00000100:00100000:2.0:1782480724.729666:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311612928 00000100:00100000:2.0:1782480724.729713:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782480724.729721:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311612928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480724.729801:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311612928:12345-0@lo:400:kworker.0 Request processed in 81us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480724.729821:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1782480724.729840:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480724.729960:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311612672:0@lo:400:kworker.0 00000100:00100000:0.0:1782480724.729970:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311613184:0@lo:400:kworker.0 00000100:00100000:0.0:1782480724.730001:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480724.730052:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311613184 00000100:00100000:0.0:1782480724.730056:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311613184 00000100:00100000:0.0:1782480724.730084:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782480724.730091:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311613184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480724.730124:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311613184:12345-0@lo:400:kworker.0 Request processed in 34us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480724.730129:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782480724.730156:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311612928:0@lo:400:kworker.0 00000100:00080000:0.0:1782480724.730171:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480724.730190:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311613184:0@lo:400:kworker.0 00000100:00100000:1.0:1782480724.736833:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311613312 00000100:00100000:1.0:1782480724.736849:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311613312 00000100:00100000:1.0:1782480724.736936:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311613056 00000100:00100000:1.0:1782480724.736939:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311613056 00000100:00100000:1.0:1782480724.736968:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782480724.736978:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311613312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480724.737069:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311613312:12345-0@lo:400:kworker.0 Request processed in 92us (9697us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480724.737076:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782480724.737093:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782480724.737116:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311613056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480724.737153:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311613056:12345-0@lo:400:kworker.0 Request processed in 40us (8597us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480724.737158:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1782480724.737210:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f2d7b80 x1869066311613312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480724.737226:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311613312:0@lo:400:kworker.0 00000100:00080000:1.0:1782480724.737252:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782480724.737255:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782480724.737273:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f2d6300 x1869066311613056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480724.737283:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311613056:0@lo:400:kworker.0 00000100:00100000:0.0:1782480725.242729:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311613440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480725.242825:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480725.243098:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311613440 00000100:00100000:0.0:1782480725.243106:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311613440 00000100:00100000:0.0:1782480725.243154:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782480725.243164:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311613440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782480725.243203:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480725.243248:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311613440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480725.243255:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1782480725.243299:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d750f8a80 x1869066311613440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480725.243315:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311613440:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782480725.686896:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782480725.818135:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 210e3ff4-fa06-469c-afa9-3e2abcd77331 00000020:00000080:0.0:1782480725.818146:0:6628:0:(genops.c:906:class_export_put()) final put ffff9b6d47348800/210e3ff4-fa06-469c-afa9-3e2abcd77331 00000020:00000080:2.0:1782480725.818230:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d47348800/210e3ff4-fa06-469c-afa9-3e2abcd77331 for lustre-OST0000 00000020:00000080:2.0:1782480725.818276:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6d4734d800 for lustre-OST0000 00010000:00010000:1.0:1782480726.712362:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480726.793213:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311613568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480726.793283:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480726.794064:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311613568 00000100:00100000:0.0:1782480726.794073:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311613568 00000100:00100000:0.0:1782480726.794144:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782480726.794154:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311613568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782480726.794190:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480726.794253:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311613568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480726.794259:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1782480726.794298:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d750f8a80 x1869066311613568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480726.794316:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311613568:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782480726.794400:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480727.127717:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480727.127784:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480727.127789:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291656704 00000100:00100000:1.0:1782480727.127799:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291656704 00000100:00100000:1.0:1782480727.127851:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 226 00000100:00100000:1.0:1782480727.127861:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d68bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2368:x1869066291656704:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480727.128405:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480727.128419:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d68bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2368:x1869066291656704:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 558us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480727.128428:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 226 00000100:00100000:2.0:1782480727.128559:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291656960 00000100:00100000:2.0:1782480727.128564:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291656960 00000100:00100000:2.0:1782480727.128618:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291656832 00000100:00100000:2.0:1782480727.128621:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291656832 00000100:00100000:2.0:1782480727.128640:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 83 00000100:00100000:2.0:1782480727.128647:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2368:x1869066291656960:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480727.128684:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2368:x1869066291656960:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 39us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480727.128691:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 83 00000100:00100000:2.0:1782480727.128702:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:2.0:1782480727.128707:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2368:x1869066291656832:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480727.128728:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2368:x1869066291656832:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 21us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480727.128734:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00080000:1.0:1782480727.129172:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782480727.736898:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782480728.750373:0:10877:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1782480728.767378:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480729.786227:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480729.847515:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311613696:0@lo:400:kworker.0 00000100:00100000:0.0:1782480729.847608:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480729.847661:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311614208:0@lo:400:kworker.0 00000100:00100000:0.0:1782480729.847720:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480729.847766:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782480729.847773:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311613824:0@lo:400:kworker.0 00000100:00100000:0.0:1782480729.847811:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480729.847831:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311614336:0@lo:400:kworker.0 00000100:00100000:0.0:1782480729.847857:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480729.847889:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311613952:0@lo:400:kworker.0 00000100:00100000:0.0:1782480729.847912:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480729.847930:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480729.847935:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311614080:0@lo:400:kworker.0 00000100:00100000:0.0:1782480729.847956:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480729.847988:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311613696 00000100:00100000:0.0:1782480729.847995:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311613696 00000100:00100000:0.0:1782480729.848042:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1782480729.848050:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d68bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311613696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480729.848105:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d68bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311613696:12345-0@lo:400:kworker.0 Request processed in 55us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480729.848113:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1782480729.848145:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311614208 00000100:00100000:0.0:1782480729.848149:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311614208 00000100:00100000:0.0:1782480729.848180:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311613824 00000100:00100000:0.0:1782480729.848183:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311613824 00000100:00100000:0.0:1782480729.848196:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311613952 00000100:00100000:0.0:1782480729.848198:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311613952 00000100:00100000:0.0:1782480729.848211:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782480729.848223:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311614208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480729.848256:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311614208:12345-0@lo:400:kworker.0 Request processed in 34us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480729.848262:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782480729.848275:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1782480729.848280:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311613824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480729.848305:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311613824:12345-0@lo:400:kworker.0 Request processed in 25us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480729.848310:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1782480729.848320:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1782480729.848325:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311613952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480729.848351:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311613952:12345-0@lo:400:kworker.0 Request processed in 26us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480729.848357:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1782480729.848378:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311614336 00000100:00100000:0.0:1782480729.848380:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311614336 00000100:00100000:0.0:1782480729.848402:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311614080 00000100:00100000:0.0:1782480729.848404:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311614080 00000100:00100000:0.0:1782480729.848419:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782480729.848424:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311614336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480729.848450:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311614336:12345-0@lo:400:kworker.0 Request processed in 26us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480729.848456:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782480729.848466:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782480729.848471:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311614080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480729.848493:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311614080:12345-0@lo:400:kworker.0 Request processed in 22us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480729.848505:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1782480729.848541:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782480729.848546:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782480729.848548:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782480729.848581:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d750fb480 x1869066311614080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480729.848595:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311614080:0@lo:400:kworker.0 00000100:00100000:0.0:1782480729.848606:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311613952:0@lo:400:kworker.0 00000100:00100000:0.0:1782480729.848633:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311613824:0@lo:400:kworker.0 00010000:00080000:0.0:1782480729.848641:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d750fa680 x1869066311614336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480729.848649:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311614336:0@lo:400:kworker.0 00000100:00100000:0.0:1782480729.848655:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311613696:0@lo:400:kworker.0 00000100:00100000:0.0:1782480729.848664:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311614208:0@lo:400:kworker.0 00000100:00100000:0.0:1782480730.359952:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782480730.359977:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311614464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480730.360064:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480730.360140:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311614464 00000100:00100000:0.0:1782480730.360149:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311614464 00000100:00100000:0.0:1782480730.360253:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782480730.360264:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311614464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782480730.360303:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480730.360351:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311614464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480730.360374:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1782480730.360418:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d753f8e00 x1869066311614464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480730.360435:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311614464:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782480730.815966:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480731.833694:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480731.895231:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480731.895261:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311614592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480731.895324:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480731.895380:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311614592 00000100:00100000:0.0:1782480731.895388:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311614592 00000100:00100000:0.0:1782480731.895435:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782480731.895443:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311614592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782480731.895487:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480731.895541:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311614592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480731.895549:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1782480731.895569:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782480731.895599:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d753f8e00 x1869066311614592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480731.895617:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311614592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480732.249048:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480732.249096:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480732.249122:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480732.249153:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291657088 00000100:00100000:1.0:1782480732.249155:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291657216 00000100:00100000:3.0:1782480732.249163:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291657088 00000100:00100000:3.0:1782480732.249320:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 228 00000100:00100000:3.0:1782480732.249331:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2368:x1869066291657088:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480732.249401:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2368:x1869066291657088:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 73us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480732.249409:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 228 00000100:00100000:3.0:1782480732.249438:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291657344 00000100:00100000:3.0:1782480732.249442:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291657344 00000100:00100000:3.0:1782480732.249491:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:3.0:1782480732.249499:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2368:x1869066291657344:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480732.249520:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291657216 00000100:00100000:3.0:1782480732.249531:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2368:x1869066291657344:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 33us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480732.249537:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:1.0:1782480732.249567:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 89 00000100:00080000:3.0:1782480732.249568:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480732.249575:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2368:x1869066291657216:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480732.249602:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2368:x1869066291657216:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 28us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480732.249608:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 89 00000020:00000080:0.0:1782480732.613447:0:11026:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd8c2fb410 20000000:00000080:0.0:1782480732.613476:0:11026:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b6d76088c00 uarg=0000000000000000 20000000:01000000:0.0:1782480732.613512:0:11026:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782480732.613518:0:11026:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782480732.613522:0:11026:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1782480732.615134:0:11027:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1782480732.615288:0:11026:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1782480732.621005:0:11026:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1782480732.621038:0:11026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023ae5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480732.621056:0:11026:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d82164000/0x3dc3ebf33c023a91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023a8a expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480732.621064:0:11026:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d40030a00/0x3dc3ebf33c023a9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023a98 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480732.621070:0:11026:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d82165e00/0x3dc3ebf33c023aad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023aa6 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480732.621080:0:11026:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d821ecc00/0x3dc3ebf33c023ab4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f77b expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480732.621086:0:11026:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d6873c600/0x3dc3ebf33c023ac9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7b3 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480732.621093:0:11026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023ae5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480732.621137:0:11026:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d6873c600/0x3dc3ebf33c023ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7b3 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480732.621152:0:11026:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d6873c600/0x3dc3ebf33c023ac9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7b3 expref: 12 pid: 5802 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480732.621165:0:11026:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11026:1869066311614720:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480732.621258:0:11026:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d821ecc00/0x3dc3ebf33c023ab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f77b expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480732.621285:0:11026:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d821ecc00/0x3dc3ebf33c023ab4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f77b expref: 12 pid: 5801 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480732.621293:0:11026:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11026:1869066311614848:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480732.621325:0:11026:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d82165e00/0x3dc3ebf33c023aad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c023aa6 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480732.621333:0:11026:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d82165e00/0x3dc3ebf33c023aad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c023aa6 expref: 18 pid: 5801 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480732.621342:0:11026:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753fbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11026:1869066311614976:0@lo:104: 00000100:00100000:0.0:1782480732.623401:0:11026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782480732.623490:0:11026:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d40030a00/0x3dc3ebf33c023a9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c023a98 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480732.623504:0:11026:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d40030a00/0x3dc3ebf33c023a9f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c023a98 expref: 18 pid: 5801 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480732.623506:0:8303:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311614976 00000100:00100000:1.0:1782480732.623514:0:8303:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311614976 00000100:00100000:0.0:1782480732.623517:0:11026:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753f8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11026:1869066311615104:0@lo:104: 00000100:00100000:0.0:1782480732.623549:0:11026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782480732.624655:0:11026:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d82164000/0x3dc3ebf33c023a91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c023a8a expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480732.624668:0:11026:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d82164000/0x3dc3ebf33c023a91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c023a8a expref: 18 pid: 5801 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480732.624680:0:11026:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753f8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11026:1869066311615232:0@lo:104: 00000100:00100000:0.0:1782480732.624709:0:11026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480732.627083:0:8303:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311615104 00000100:00100000:1.0:1782480732.627097:0:8303:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311615104 00000100:00100000:2.0:1782480732.627168:0:5790:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311615232 00000100:00100000:2.0:1782480732.627172:0:5790:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311615232 00000100:00100000:2.0:1782480732.627229:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782480732.627239:0:5790:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+5:11026:x1869066311614976:12345-0@lo:104: 00010000:00010000:2.0:1782480732.627256:0:5790:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aa6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023aad expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480732.627311:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782480732.627321:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+5:11026:x1869066311615232:12345-0@lo:104: 00010000:00010000:3.0:1782480732.627329:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d6873da00/0x3dc3ebf33c023a8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023a91 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480732.636299:0:11026:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46a5b180 going to sleep for 11 seconds 00000100:00100000:1.0:1782480732.636935:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480732.636995:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480732.637031:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291657600 00000100:00100000:1.0:1782480732.637040:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291657600 00010000:00010000:1.0:1782480732.637082:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d821ecc00/0x3dc3ebf33c023ab4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f77b expref: 13 pid: 5801 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480732.637113:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291657472 00000100:00100000:1.0:1782480732.637116:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291657472 00010000:00010000:1.0:1782480732.637130:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d6873c600/0x3dc3ebf33c023ac9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7b3 expref: 14 pid: 5802 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480732.637150:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:1.0:1782480732.637159:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d465ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+14:2367:x1869066291657600:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480732.637173:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480732.637179:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d821ecc00/0x3dc3ebf33c023ab4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f77b expref: 14 pid: 5801 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480732.637210:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d821ecc00/0x3dc3ebf33c023ab4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f77b expref: 14 pid: 5801 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480732.637230:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480732.637279:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d465ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+14:2367:x1869066291657600:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 120us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480732.637286:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:0.0:1782480732.637485:0:11026:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11026:1869066311614720:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480732.637523:0:11026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d821ecc00/0x3dc3ebf33c023ab4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f77b expref: 14 pid: 5801 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480732.637537:0:11026:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11026:1869066311614848:192.168.204.51@tcp:104: 00010000:00010000:2.0:1782480732.637707:0:5790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782480732.637714:0:5790:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+5:11026:x1869066311614976:12345-0@lo:104: Request processed in 10477us (14319us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480732.637721:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782480732.637902:0:11026:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753fbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11026:1869066311614976:0@lo:104: 00000100:00100000:2.0:1782480732.637982:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:2.0:1782480732.637993:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2367:x1869066291657472:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480732.638002:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480732.638008:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d6873c600/0x3dc3ebf33c023ac9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7b3 expref: 13 pid: 5802 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480732.638018:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d6873c600/0x3dc3ebf33c023ac9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7b3 expref: 13 pid: 5802 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480732.638030:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d6873c600/0x3dc3ebf33c023ac9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7b3 expref: 13 pid: 5802 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480732.638038:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480732.638060:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:2367:x1869066291657472:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 70us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480732.638066:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:2.0:1782480732.638121:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782480732.638129:0:8303:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+4:11026:x1869066311615104:12345-0@lo:104: 00010000:00010000:2.0:1782480732.638140:0:8303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c000/0x3dc3ebf33c023a98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023a9f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480732.638194:0:8303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782480732.638200:0:8303:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+4:11026:x1869066311615104:12345-0@lo:104: Request processed in 73us (14651us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480732.638206:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782480732.638274:0:11026:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753f8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11026:1869066311615104:0@lo:104: 00010000:00010000:3.0:1782480732.638505:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782480732.638511:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aa6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023aad expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.638527:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ec400 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:3.0:1782480732.638531:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aa6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c023aad expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.638539:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c023aad expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480732.638545:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c023aad expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480732.638550:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782480732.638690:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aa6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023aad expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.638697:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480732.638734:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aa6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023aad expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.638742:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aa6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023aad expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.638774:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480732.638777:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c000/0x3dc3ebf33c023a98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023a9f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.638782:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6873c000 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:3.0:1782480732.638785:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c000/0x3dc3ebf33c023a98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c023a9f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.638800:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c000/0x3dc3ebf33c023a98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c023a9f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480732.638806:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c000/0x3dc3ebf33c023a98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c023a9f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480732.638811:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1782480732.638941:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7591f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311615360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480732.638979:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480732.639074:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311615360 00000100:00100000:0.0:1782480732.639079:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311615360 00010000:00010000:0.0:1782480732.639099:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d82165e00/0x3dc3ebf33c023aad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023aa6 expref: 19 pid: 5801 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480732.639116:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782480732.639123:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311615360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782480732.639134:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480732.639138:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d82165e00/0x3dc3ebf33c023aad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023aa6 expref: 19 pid: 5801 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480732.639147:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d82165e00/0x3dc3ebf33c023aad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c023aa6 expref: 19 pid: 5801 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480732.639161:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d82165e00/0x3dc3ebf33c023aad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c023aa6 expref: 19 pid: 5801 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480732.639172:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480732.639204:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fffafe6-aedd-4500-93d4-974eea0c11af+18:3315:x1869066311615360:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480732.639210:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1782480732.639235:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480732.639237:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7591f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311615360:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782480732.639442:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c000/0x3dc3ebf33c023a98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023a9f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.639449:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480732.639474:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c000/0x3dc3ebf33c023a98 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023a9f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.639481:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d6873c000/0x3dc3ebf33c023a98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023a9f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.639490:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480732.639492:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480732.639493:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480732.639514:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7591f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311615488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782480732.639541:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782480732.639600:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782480732.639606:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+3:11026:x1869066311615232:12345-0@lo:104: Request processed in 12287us (14897us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480732.639612:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782480732.639870:0:11026:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753f8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11026:1869066311615232:0@lo:104: 00010000:00010000:0.0:1782480732.639898:0:11026:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023ae5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.639971:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480732.639976:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d6873da00/0x3dc3ebf33c023a8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023a91 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.639990:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6873da00 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:3.0:1782480732.639993:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6873da00/0x3dc3ebf33c023a8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c023a91 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.640000:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d6873da00/0x3dc3ebf33c023a8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c023a91 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480732.640005:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6873da00/0x3dc3ebf33c023a8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c023a91 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480732.640009:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782480732.640063:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d6873da00/0x3dc3ebf33c023a8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023a91 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.640069:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480732.640089:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d6873da00/0x3dc3ebf33c023a8a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023a91 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.640095:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d6873da00/0x3dc3ebf33c023a8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023a91 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.640106:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480732.640108:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480732.640109:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480732.640116:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782480732.640125:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311615616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782480732.640153:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480732.640178:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311615488 00000100:00100000:3.0:1782480732.640183:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311615488 00010000:00010000:3.0:1782480732.640208:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d40030a00/0x3dc3ebf33c023a9f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023a98 expref: 18 pid: 5801 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480732.640226:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311615616 00000100:00100000:3.0:1782480732.640229:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311615616 00000100:00100000:1.0:1782480732.640280:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782480732.640289:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48577b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3316:x1869066311615488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782480732.641411:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480732.641420:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d40030a00/0x3dc3ebf33c023a9f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023a98 expref: 19 pid: 5801 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480732.641434:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d40030a00/0x3dc3ebf33c023a9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c023a98 expref: 19 pid: 5801 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480732.641448:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40030a00/0x3dc3ebf33c023a9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c023a98 expref: 19 pid: 5801 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480732.641473:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480732.641530:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48577b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+18:3316:x1869066311615488:12345-0@lo:103:ldlm_bl.0 Request processed in 1242us (1987us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480732.641538:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782480732.641589:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7591f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311615488:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782480732.642574:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d82164000/0x3dc3ebf33c023a91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023a8a expref: 19 pid: 5801 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480732.642849:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782480732.642865:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fffafe6-aedd-4500-93d4-974eea0c11af+17:3318:x1869066311615616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782480732.642880:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480732.642888:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d82164000/0x3dc3ebf33c023a91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023a8a expref: 17 pid: 5801 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.642899:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d82164000/0x3dc3ebf33c023a91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c023a8a expref: 17 pid: 5801 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.642913:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d82164000/0x3dc3ebf33c023a91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c023a8a expref: 17 pid: 5801 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.642928:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023ae5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.642937:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023ae5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.642952:0:8304:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023ae5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.642959:0:8304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023ae5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.642982:0:8304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023ae5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.642989:0:8304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023ae5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.642995:0:8304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40031a00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:3.0:1782480732.643000:0:8304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023ae5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.643008:0:8304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023ae5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480732.643317:0:11026:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023ae5 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480732.643326:0:11026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023ae5 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.644493:0:8304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023ae5 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.644508:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40031a00/0x3dc3ebf33c023ae5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480732.644592:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480732.645875:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fffafe6-aedd-4500-93d4-974eea0c11af+16:3318:x1869066311615616:12345-0@lo:103:ldlm_bl.0 Request processed in 3009us (5712us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480732.645888:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782480732.646802:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311615616:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782480732.859024:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782480733.752866:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782480733.752873:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9b6d7581c000 from 7 10000000:01000000:3.0:1782480733.752878:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782480733.752920:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480733.752931:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480733.752957:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480733.752983:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311615744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782480733.753047:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480733.753107:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d751db300 going to sleep for 11 seconds 00000100:00100000:0.0:1782480733.753506:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311615744 00000100:00100000:0.0:1782480733.753513:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311615744 00000100:00100000:0.0:1782480733.753566:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1782480733.753578:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+16:5804:x1869066311615744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782480733.753593:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480733.753609:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40030400/0x3dc3ebf33c023af3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023aec expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480733.753634:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40030400/0x3dc3ebf33c023af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023aec expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480733.753645:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40030400/0x3dc3ebf33c023af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023aec expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480733.753654:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40030400, rc 0) 00000100:00100000:0.0:1782480733.753715:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311615744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480733.753723:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1782480733.753779:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311615744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480733.753796:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023af3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480733.753806:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023af3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480733.753861:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f128380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311615872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480733.753887:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480733.753918:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51212cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480733.754231:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311615872 00000100:00100000:0.0:1782480733.754236:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311615872 00000100:00100000:0.0:1782480733.754271:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1782480733.754278:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311615872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480733.757834:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311615872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3546us (3936us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480733.757849:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1782480733.763581:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f128380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311615872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480733.763647:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f128380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311616000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480733.763893:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480733.763940:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51212cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480733.764248:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311616000 00000100:00100000:0.0:1782480733.764257:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311616000 00000100:00100000:0.0:1782480733.764311:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1782480733.764321:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311616000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782480733.765319:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311616000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 996us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480733.765330:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1782480733.767697:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f128380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311616000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782480733.771966:0:11052:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1782480733.772195:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1782480733.772216:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782480733.772229:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023af3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480733.772241:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023af3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480733.772252:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782480733.772255:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9b6d46055800 from 7 10000000:01000000:2.0:1782480733.772257:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782480733.772295:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d800/0x3dc3ebf33c023afa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480733.772303:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d800/0x3dc3ebf33c023afa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480733.772314:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d800/0x3dc3ebf33c023afa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480733.772355:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311616128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782480733.775482:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480733.775537:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7b17c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480733.775695:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311616128 00000100:00100000:0.0:1782480733.775705:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311616128 00000100:00100000:0.0:1782480733.775769:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1782480733.775779:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311616128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782480733.775796:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480733.775814:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d40030a00/0x3dc3ebf33c023b01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023afa expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480733.775843:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d40030a00/0x3dc3ebf33c023b01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023afa expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480733.775869:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d40030a00/0x3dc3ebf33c023b01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023afa expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480733.775877:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40030a00, rc 0) 00000100:00100000:0.0:1782480733.775935:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311616128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480733.775943:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1782480733.776482:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311616128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480733.776502:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d800/0x3dc3ebf33c023afa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023b01 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480733.776512:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d800/0x3dc3ebf33c023afa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023b01 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480733.777089:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311616256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480733.777494:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480733.777534:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7b17c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480733.778846:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311616256 00000100:00100000:1.0:1782480733.778859:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311616256 00000100:00100000:1.0:1782480733.778912:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1782480733.778922:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311616256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480733.780192:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311616256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1268us (2695us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480733.780202:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1782480733.781715:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311616256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480733.781795:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311616384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480733.781873:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480733.781919:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7b17c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480733.783695:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311616384 00000100:00100000:1.0:1782480733.783708:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311616384 00000100:00100000:1.0:1782480733.783788:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1782480733.783798:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311616384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480733.784020:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311616384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 223us (2146us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480733.784027:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1782480733.784396:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311616384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782480733.785967:0:11054:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1782480733.786227:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1782480733.786246:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782480733.786257:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d800/0x3dc3ebf33c023afa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023b01 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480733.786269:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d800/0x3dc3ebf33c023afa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023b01 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480733.786280:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782480733.786292:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9b6d47c9a800 from 7 10000000:01000000:2.0:1782480733.786296:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782480733.786330:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873cc00/0x3dc3ebf33c023b08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480733.786404:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d6873cc00/0x3dc3ebf33c023b08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480733.786489:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d6873cc00/0x3dc3ebf33c023b08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480733.786513:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311616512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782480733.786572:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480733.786660:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7b17c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480733.790568:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311616512 00000100:00100000:1.0:1782480733.790584:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311616512 00000100:00100000:1.0:1782480733.790977:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1782480733.790988:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311616512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480733.791004:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480733.791022:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d6e573200/0x3dc3ebf33c023b0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023b08 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480733.791049:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d6e573200/0x3dc3ebf33c023b0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023b08 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480733.791060:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d6e573200/0x3dc3ebf33c023b0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023b08 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480733.791069:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573200, rc 0) 00000100:00100000:1.0:1782480733.791153:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311616512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (4581us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480733.791159:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1782480733.793635:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311616512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480733.793662:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d6873cc00/0x3dc3ebf33c023b08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023b0f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480733.793673:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d6873cc00/0x3dc3ebf33c023b08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023b0f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480733.793765:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311616640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480733.793821:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480733.794288:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7b17c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480733.798053:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311616640 00000100:00100000:1.0:1782480733.798068:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311616640 00000100:00100000:1.0:1782480733.798115:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1782480733.798125:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311616640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480733.798565:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311616640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 441us (4742us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480733.798584:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1782480733.798787:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311616640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480733.798839:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f128e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311616768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480733.798881:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480733.798910:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51212d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782480733.798933:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311616768 00000100:00100000:1.0:1782480733.798938:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311616768 00000100:00100000:1.0:1782480733.798956:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1782480733.798961:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311616768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480733.799120:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311616768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480733.799128:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1782480733.799329:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f128e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311616768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782480733.801925:0:11057:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1782480733.806539:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1782480733.806574:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782480733.806587:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873cc00/0x3dc3ebf33c023b08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023b0f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480733.806739:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d6873cc00/0x3dc3ebf33c023b08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023b0f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480733.878910:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480734.297211:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480734.301213:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291657728 00000100:00100000:1.0:1782480734.301228:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291657728 00000100:00100000:1.0:1782480734.301301:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 238 00000100:00100000:1.0:1782480734.301311:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+11:5584:x1869066291657728:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480734.301338:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480734.301355:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d6e573600/0x3dc3ebf33c023b16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f7dd expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480734.301381:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d6e573600/0x3dc3ebf33c023b16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7dd expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480734.301393:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d6e573600/0x3dc3ebf33c023b16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7dd expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480734.301402:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573600, rc 0) 00000100:00100000:1.0:1782480734.301480:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:5584:x1869066291657728:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 170us (4279us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480734.301488:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 238 00000100:00100000:1.0:1782480734.304319:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480734.304416:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291657856 00000100:00100000:0.0:1782480734.304426:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291657856 00000100:00100000:0.0:1782480734.304485:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 239 00000100:00100000:0.0:1782480734.304493:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:5584:x1869066291657856:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480734.304786:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:5584:x1869066291657856:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 292us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480734.304793:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 239 00000100:00100000:0.0:1782480734.314614:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480734.314882:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291657984 00000100:00100000:3.0:1782480734.314902:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291657984 00000100:00100000:3.0:1782480734.314957:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 240 00000100:00100000:3.0:1782480734.314968:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:5584:x1869066291657984:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782480734.315205:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:5584:x1869066291657984:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 238us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480734.315214:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 240 00000100:00100000:3.0:1782480734.328060:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480734.328392:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291658112 00000100:00100000:1.0:1782480734.328403:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291658112 00000100:00100000:1.0:1782480734.328462:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 241 00000100:00100000:1.0:1782480734.328472:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:5584:x1869066291658112:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480734.328491:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480734.328508:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d6e573000/0x3dc3ebf33c023b1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f7e4 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480734.328539:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d6e573000/0x3dc3ebf33c023b1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7e4 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480734.328550:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d6e573000/0x3dc3ebf33c023b1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7e4 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480734.328575:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573000, rc 0) 00000100:00100000:1.0:1782480734.328628:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:5584:x1869066291658112:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 157us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480734.328635:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 241 00000100:00100000:1.0:1782480734.339366:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480734.339460:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291658240 00000100:00100000:0.0:1782480734.339470:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291658240 00000100:00100000:0.0:1782480734.339530:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 242 00000100:00100000:0.0:1782480734.339541:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:5584:x1869066291658240:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480734.340279:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:5584:x1869066291658240:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 343us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480734.340292:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 242 00000100:00100000:0.0:1782480734.341859:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480734.341995:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291658368 00000100:00100000:3.0:1782480734.342003:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291658368 00000100:00100000:3.0:1782480734.342049:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 243 00000100:00100000:3.0:1782480734.342057:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:5584:x1869066291658368:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782480734.342261:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:5584:x1869066291658368:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 203us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480734.342269:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 243 00010000:00010000:3.0:1782480734.902889:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480734.971111:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311616896:0@lo:400:kworker.0 00000100:00100000:1.0:1782480734.971183:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480734.971995:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311616896 00000100:00100000:2.0:1782480734.972005:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311616896 00000100:00100000:2.0:1782480734.972056:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1782480734.972066:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3318:x1869066311616896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480734.974621:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3318:x1869066311616896:12345-0@lo:400:kworker.0 Request processed in 2549us (3430us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480734.974644:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1782480734.975918:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f1c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311617408:0@lo:400:kworker.0 00000100:00100000:3.0:1782480734.975923:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f1c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311617280:0@lo:400:kworker.0 00000100:00100000:3.0:1782480734.975985:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480734.976036:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311617024:0@lo:400:kworker.0 00000100:00100000:1.0:1782480734.976050:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480734.976074:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1869066311617152:0@lo:400:kworker.0 00000100:00100000:3.0:1782480734.976124:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480734.976172:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311616896:0@lo:400:kworker.0 00000100:00100000:3.0:1782480734.976182:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311617280 00000100:00100000:2.0:1782480734.976270:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311617408 00000100:00100000:2.0:1782480734.976277:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311617408 00000100:00100000:2.0:1782480734.976334:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311617152 00000100:00100000:2.0:1782480734.976337:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311617152 00000100:00100000:2.0:1782480734.976359:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782480734.976367:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869066311617408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480734.976411:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869066311617408:12345-0@lo:400:kworker.0 Request processed in 45us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480734.976429:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782480734.976441:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1782480734.976446:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311617280 00000100:00100000:2.0:1782480734.976447:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869066311617152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480734.976705:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782480734.976714:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311617280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480734.977063:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311617280:12345-0@lo:400:kworker.0 Request processed in 349us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480734.977072:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782480734.977300:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869066311617152:12345-0@lo:400:kworker.0 Request processed in 852us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480734.977307:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1782480734.977339:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480734.977348:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1869066311617152:0@lo:400:kworker.0 00000100:00100000:2.0:1782480734.977381:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f1c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311617408:0@lo:400:kworker.0 00000100:00100000:3.0:1782480734.977529:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f1c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311617536:0@lo:400:kworker.0 00000100:00080000:1.0:1782480734.977678:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782480734.977683:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480734.977953:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480734.977988:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311617024 00000100:00100000:3.0:1782480734.977993:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311617024 00000100:00100000:3.0:1782480734.978025:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1782480734.978033:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311617024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480734.978076:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311617024:12345-0@lo:400:kworker.0 Request processed in 44us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480734.978082:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:3.0:1782480734.978125:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f1c3800 x1869066311617280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480734.978137:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f1c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311617280:0@lo:400:kworker.0 00000100:00100000:3.0:1782480734.979021:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311617024:0@lo:400:kworker.0 00000100:00100000:0.0:1782480734.983507:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311617536 00000100:00100000:0.0:1782480734.983524:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311617536 00000100:00100000:0.0:1782480734.983604:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782480734.983614:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311617536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480734.983722:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311617536:12345-0@lo:400:kworker.0 Request processed in 109us (6157us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480734.983730:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1782480734.983870:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782480734.983985:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f1c1500 x1869066311617536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480734.984005:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f1c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311617536:0@lo:400:kworker.0 00000100:00100000:3.0:1782480735.481651:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480735.481677:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311617664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480735.481762:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480735.481809:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311617664 00000100:00100000:0.0:1782480735.481819:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311617664 00000100:00100000:0.0:1782480735.481870:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782480735.481879:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311617664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782480735.481917:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480735.481974:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311617664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480735.481982:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1782480735.482009:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d753f8380 x1869066311617664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480735.482030:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311617664:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782480735.927694:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480736.953438:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480737.019319:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f1c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311617792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480737.019396:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480737.019476:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311617792 00000100:00100000:3.0:1782480737.019484:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311617792 00000100:00100000:3.0:1782480737.019539:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782480737.019547:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311617792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480737.019653:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480737.019698:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311617792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480737.019705:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1782480737.019724:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782480737.019875:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f1c3800 x1869066311617792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480737.019908:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f1c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311617792:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1782480737.205455:0:11224:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1782480737.396111:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480737.396148:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480737.396394:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480737.396421:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291658496 00000100:00100000:1.0:1782480737.396440:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291658496 00000100:00100000:1.0:1782480737.396488:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 245 00000100:00100000:1.0:1782480737.396499:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2366:x1869066291658496:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480737.396610:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2366:x1869066291658496:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 113us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480737.396617:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 245 00000100:00100000:3.0:1782480737.396635:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291658752 00000100:00100000:3.0:1782480737.396639:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291658752 00000100:00100000:3.0:1782480737.396675:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291658624 00000100:00100000:3.0:1782480737.396678:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291658624 00000100:00100000:3.0:1782480737.396699:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 93 00000100:00100000:3.0:1782480737.396706:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291658752:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480737.396737:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291658752:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 32us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480737.396744:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 93 00000100:00100000:3.0:1782480737.396787:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00100000:3.0:1782480737.396794:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2366:x1869066291658624:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480737.396818:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2366:x1869066291658624:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 25us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480737.396824:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00080000:3.0:1782480737.396839:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782480737.977057:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480739.007529:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480740.023554:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480740.088021:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1869066311618176:0@lo:400:kworker.0 00000100:00100000:2.0:1782480740.088090:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480740.088144:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1782480740.088151:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311618048:0@lo:400:kworker.0 00000100:00100000:2.0:1782480740.088175:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480740.088190:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d47379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311618560:0@lo:400:kworker.0 00000100:00100000:2.0:1782480740.088226:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480740.088305:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311617920:0@lo:400:kworker.0 00000100:00100000:3.0:1782480740.088362:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480740.088394:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311618432:0@lo:400:kworker.0 00000100:00100000:3.0:1782480740.088416:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480740.088436:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782480740.088450:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311618304:0@lo:400:kworker.0 00000100:00100000:3.0:1782480740.088474:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480740.088507:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311618176 00000100:00100000:3.0:1782480740.088514:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311618176 00000100:00100000:3.0:1782480740.088559:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311618048 00000100:00100000:3.0:1782480740.088562:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311618048 00000100:00100000:3.0:1782480740.088573:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311618432 00000100:00100000:3.0:1782480740.088576:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311618432 00000100:00100000:3.0:1782480740.088607:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1782480740.088615:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869066311618176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480740.088670:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869066311618176:12345-0@lo:400:kworker.0 Request processed in 55us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480740.088677:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1782480740.088695:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782480740.088700:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311618048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480740.088725:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311618048:12345-0@lo:400:kworker.0 Request processed in 25us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480740.088730:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782480740.088738:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782480740.088743:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869066311618432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480740.088792:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869066311618432:12345-0@lo:400:kworker.0 Request processed in 49us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480740.088798:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782480740.088820:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311618560 00000100:00100000:3.0:1782480740.088823:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311618560 00000100:00100000:3.0:1782480740.088847:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311618304 00000100:00100000:3.0:1782480740.088850:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311618304 00000100:00100000:3.0:1782480740.088868:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782480740.088882:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4737a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311618560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480740.088914:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4737a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311618560:12345-0@lo:400:kworker.0 Request processed in 34us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480740.088920:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782480740.088931:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782480740.088936:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311618304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480740.088959:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311618304:12345-0@lo:400:kworker.0 Request processed in 24us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480740.088964:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1782480740.088983:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782480740.088986:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782480740.088989:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480740.089022:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311618048:0@lo:400:kworker.0 00010000:00080000:3.0:1782480740.089034:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d47379f80 x1869066311618560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480740.089044:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d47379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311618560:0@lo:400:kworker.0 00000100:00100000:3.0:1782480740.089053:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1869066311618176:0@lo:400:kworker.0 00010000:00080000:3.0:1782480740.089081:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f2d5c00 x1869066311618304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480740.089089:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311618304:0@lo:400:kworker.0 00000100:00100000:3.0:1782480740.089096:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311618432:0@lo:400:kworker.0 00000100:00100000:2.0:1782480740.089247:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311617920 00000100:00100000:2.0:1782480740.089252:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311617920 00000100:00100000:2.0:1782480740.089286:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1782480740.089293:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3318:x1869066311617920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480740.089339:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3318:x1869066311617920:12345-0@lo:400:kworker.0 Request processed in 47us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480740.089345:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1782480740.089419:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311617920:0@lo:400:kworker.0 00000100:00100000:1.0:1782480740.599398:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782480740.599422:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311618688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480740.599504:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480740.599764:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311618688 00000100:00100000:3.0:1782480740.599779:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311618688 00000100:00100000:3.0:1782480740.599833:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782480740.599843:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311618688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782480740.599881:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480740.599930:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f129180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311618688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480740.599938:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1782480740.600344:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d753f8a80 x1869066311618688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480740.600363:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311618688:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782480741.046872:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782480742.025817:0:11324:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 09:32:20 (1782480740) === 00010000:00010000:0.0:1782480742.071003:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480742.135129:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311618816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480742.135205:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480742.135306:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311618816 00000100:00100000:3.0:1782480742.135313:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311618816 00000100:00100000:3.0:1782480742.135365:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782480742.135375:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311618816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480742.135415:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480742.135475:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311618816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480742.135481:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1782480742.135502:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782480742.135530:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7ac1d500 x1869066311618816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480742.135549:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311618816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480742.318122:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480742.318247:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480742.319045:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291658880 00000100:00100000:0.0:1782480742.319058:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291658880 00000100:00100000:0.0:1782480742.319126:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:0.0:1782480742.319137:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2368:x1869066291658880:12345-192.168.204.51@tcp:41:mkdir.0 00000004:00000024:0.0:1782480742.319178:0:5809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782480742.319265:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2368:x1869066291658880:12345-192.168.204.51@tcp:41:mkdir.0 Request processed in 131us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480742.319285:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00080000:3.0:1782480742.319506:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480742.324061:0:5816:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291659008 00000100:00100000:1.0:1782480742.324078:0:5816:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291659008 00000100:00100000:1.0:1782480742.324148:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:1.0:1782480742.324161:0:5816:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:49099535-dcd3-436f-aa96-9770a3f52e5b+6:9676:x1869066291659008:12345-192.168.204.51@tcp:700:mkdir.0 00000100:00100000:1.0:1782480742.324268:0:5816:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:49099535-dcd3-436f-aa96-9770a3f52e5b+6:9676:x1869066291659008:12345-192.168.204.51@tcp:700:mkdir.0 Request processed in 109us (6156us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480742.324286:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:3.0:1782480742.329923:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480742.332318:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291659264 00000100:00100000:0.0:1782480742.332333:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291659264 00000100:00100000:0.0:1782480742.332470:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:0.0:1782480742.332481:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:9676:x1869066291659264:12345-192.168.204.51@tcp:36:mkdir.0 00010000:00010000:0.0:1782480742.332554:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480742.332584:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873dc00/0x3dc3ebf33c023a05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f766 expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.332607:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d45d62900) 00010000:00010000:0.0:1782480742.332619:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480742.332970:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40031a00/0x3dc3ebf33c023b24 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.332985:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40031a00/0x3dc3ebf33c023b24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.332995:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40031a00/0x3dc3ebf33c023b24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.333063:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b2b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.333071:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.333077:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480742.334403:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1782480742.334421:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40031a00/0x3dc3ebf33c023b24 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.334431:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40031a00/0x3dc3ebf33c023b24 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.334438:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40031a00/0x3dc3ebf33c023b24 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.334451:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40031a00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480742.334456:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40031a00/0x3dc3ebf33c023b24 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.334463:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40031a00/0x3dc3ebf33c023b24 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.334476:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d43255200) 00010000:00010000:0.0:1782480742.334479:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480742.334483:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40031a00/0x3dc3ebf33c023b24 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.334489:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40031a00/0x3dc3ebf33c023b24 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782480742.334508:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039c1e6d4 reply state 00000000e75a87f9 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480742.334517:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782480742.334608:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+7:9676:x1869066291659264:12345-192.168.204.51@tcp:36:mkdir.0 Request processed in 2125us (4691us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1782480742.334615:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00010000:00010000:1.0:1782480742.342124:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b2b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.342144:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b2b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.342157:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b2b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.342164:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40030e00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480742.342168:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b2b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.342176:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b2b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.342200:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b6d43255e00) 00010000:00010000:1.0:1782480742.342217:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480742.342222:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b2b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.342229:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b2b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480742.354593:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480742.354681:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291659392 00000100:00100000:0.0:1782480742.354692:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291659392 00000100:00100000:0.0:1782480742.354793:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:0.0:1782480742.354804:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:9677:x1869066291659392:12345-192.168.204.51@tcp:101:chmod.0 00010000:00010000:0.0:1782480742.354827:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480742.354850:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40031a00/0x3dc3ebf33c023b32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f7eb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.354948:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.354962:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.354973:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480742.355037:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1782480742.355041:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480742.355079:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.355101:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40031a00/0x3dc3ebf33c023b32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7eb expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.355120:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7eb expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.355128:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d43255200) 00010000:00010000:0.0:1782480742.355131:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782480742.355134:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d40030e00, rc 0) 00000100:00100000:0.0:1782480742.359519:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+7:9677:x1869066291659392:12345-192.168.204.51@tcp:101:chmod.0 Request processed in 4702us (4921us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480742.359534:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:2.0:1782480742.367667:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480742.367790:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291659648 00000100:00100000:3.0:1782480742.367812:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291659648 00000100:00100000:3.0:1782480742.367876:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:3.0:1782480742.368126:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+7:9677:x1869066291659648:12345-192.168.204.51@tcp:36:chmod.0 00010000:00010000:3.0:1782480742.368212:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480742.368243:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7eb expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.368279:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d43255200) 00010000:00010000:3.0:1782480742.368292:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782480742.368321:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ece00/0x3dc3ebf33c023b40 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.368334:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ece00/0x3dc3ebf33c023b40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.368344:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ece00/0x3dc3ebf33c023b40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782480742.368844:0:5807:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f236d290 reply state 000000009cae430b transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ece00/0x3dc3ebf33c023b40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480742.368856:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782480742.368870:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1782480742.369247:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+8:9677:x1869066291659648:12345-192.168.204.51@tcp:36:chmod.0 Request processed in 1360us (1610us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1782480742.369255:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00010000:00010000:3.0:1782480742.377661:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ece00/0x3dc3ebf33c023b40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.377696:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ece00/0x3dc3ebf33c023b40 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.377703:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ece00/0x3dc3ebf33c023b40 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.377709:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ece00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480742.377715:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ece00/0x3dc3ebf33c023b40 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.377723:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ece00/0x3dc3ebf33c023b40 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.377741:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddc500) 00010000:00010000:3.0:1782480742.377744:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782480742.377768:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ece00/0x3dc3ebf33c023b40 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.377775:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ece00/0x3dc3ebf33c023b40 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480742.399298:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480742.399837:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291659776 00000100:00100000:3.0:1782480742.399848:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291659776 00000100:00100000:3.0:1782480742.399968:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:3.0:1782480742.399980:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4737b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+7:9678:x1869066291659776:12345-192.168.204.51@tcp:101:chown.0 00010000:00010000:3.0:1782480742.400008:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480742.400034:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ece00/0x3dc3ebf33c023b47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f7f2 expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.400109:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023b4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.400137:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.400149:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480742.400223:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1782480742.400227:0:10450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480742.400290:0:10450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023b4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.400319:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ece00/0x3dc3ebf33c023b47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7f2 expref: 9 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.400337:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023b4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7f2 expref: 8 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.400346:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddc500) 00010000:00010000:3.0:1782480742.400350:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782480742.400353:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ec000, rc 0) 00000100:00100000:3.0:1782480742.400435:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4737b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+8:9678:x1869066291659776:12345-192.168.204.51@tcp:101:chown.0 Request processed in 449us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480742.400443:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:2.0:1782480742.403599:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480742.404175:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291659904 00000100:00100000:0.0:1782480742.404186:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291659904 00000100:00100000:0.0:1782480742.404263:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:0.0:1782480742.404284:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+8:9678:x1869066291659904:12345-192.168.204.51@tcp:101:chown.0 00010000:00010000:0.0:1782480742.404304:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480742.404326:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40031a00/0x3dc3ebf33c023b55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f7f9 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404396:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404412:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404437:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404469:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d800/0x3dc3ebf33c023b63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404478:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d800/0x3dc3ebf33c023b63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404485:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d800/0x3dc3ebf33c023b63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404610:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d200/0x3dc3ebf33c023b6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404618:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d200/0x3dc3ebf33c023b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404625:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d200/0x3dc3ebf33c023b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480742.404679:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1782480742.404683:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480742.404712:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d200/0x3dc3ebf33c023b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404725:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404731:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b5c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404738:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404782:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40030e00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480742.404788:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404795:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404808:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddc500) 00010000:00010000:0.0:1782480742.404811:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480742.404816:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404822:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40030e00/0x3dc3ebf33c023b5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404836:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d800/0x3dc3ebf33c023b63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404852:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d800/0x3dc3ebf33c023b63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404857:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d800/0x3dc3ebf33c023b63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404861:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2d800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480742.404864:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d800/0x3dc3ebf33c023b63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404870:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d800/0x3dc3ebf33c023b63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404879:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b6d43255500) 00010000:00010000:0.0:1782480742.404881:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480742.404883:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d800/0x3dc3ebf33c023b63 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404902:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d800/0x3dc3ebf33c023b63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404938:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d40031a00/0x3dc3ebf33c023b55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7f9 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404953:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d200/0x3dc3ebf33c023b6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7f9 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.404960:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d43255f00) 00010000:00010000:0.0:1782480742.405066:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782480742.405075:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2d200, rc 0) 00000100:00100000:0.0:1782480742.405145:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+9:9678:x1869066291659904:12345-192.168.204.51@tcp:101:chown.0 Request processed in 872us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480742.405153:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:2.0:1782480742.409623:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480742.409700:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291660160 00000100:00100000:0.0:1782480742.409710:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291660160 00000100:00100000:0.0:1782480742.409796:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:0.0:1782480742.409807:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+9:9678:x1869066291660160:12345-192.168.204.51@tcp:36:chown.0 00010000:00010000:0.0:1782480742.409865:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480742.409901:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d200/0x3dc3ebf33c023b6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7f9 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.409924:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d43255f00) 00010000:00010000:0.0:1782480742.409934:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480742.409958:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c023b71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.409980:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c023b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.409991:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c023b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782480742.449246:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1782480742.449308:0:5809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000497f407f reply state 000000001f731020 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c023b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480742.449321:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782480742.449489:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1782480742.449713:0:5809:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1782480742.449735:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+7:9678:x1869066291660160:12345-192.168.204.51@tcp:36:chown.0 Request processed in 39919us (40112us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1782480742.449744:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00010000:00010000:1.0:1782480742.450671:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c023b71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.450683:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c023b71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.450691:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c023b71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.450698:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2ce00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480742.450703:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c023b71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.450709:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c023b71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.450726:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d43255200) 00010000:00010000:1.0:1782480742.450729:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782480742.450733:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c023b71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.450740:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c023b71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480742.478503:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480742.479053:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291660288 00000100:00100000:0.0:1782480742.479064:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291660288 00000100:00100000:0.0:1782480742.479316:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:0.0:1782480742.479328:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:9679:x1869066291660288:12345-192.168.204.51@tcp:101:touch.500 00010000:00010000:0.0:1782480742.479354:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480742.479374:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d800/0x3dc3ebf33c023b78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f800 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782480742.480887:0:5808:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1428us 00000100:00100000:0.0:1782480742.495769:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480742.495815:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480742.495848:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291660544 00000100:00100000:0.0:1782480742.495857:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291660544 00000100:00100000:0.0:1782480742.495921:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 98 00000100:00100000:0.0:1782480742.495930:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2367:x1869066291660544:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480742.496026:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2367:x1869066291660544:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 96us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480742.496034:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 98 00000100:00080000:0.0:1782480742.496058:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480742.496400:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291660416 00000100:00100000:1.0:1782480742.496405:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291660416 00000100:00100000:1.0:1782480742.496460:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 247 00000100:00100000:1.0:1782480742.496468:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2367:x1869066291660416:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480742.496512:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2367:x1869066291660416:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 44us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480742.496519:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 247 00010000:00010000:1.0:1782480742.515367:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023b7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.515391:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023b7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.515404:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023b7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.515420:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c023b86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.515427:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c023b86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.515432:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c023b86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.516283:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023b8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.516296:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.516304:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480742.516386:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782480742.516390:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782480742.516646:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.516662:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023b7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.516669:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023b7f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.516677:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023b7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.516683:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480742.516687:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023b7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.516694:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023b7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.516786:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddc500) 00010000:00010000:1.0:1782480742.516790:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480742.516840:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023b7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.516847:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023b7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.516860:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c023b86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.516876:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c023b86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.516882:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c023b86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.516888:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572e00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480742.516891:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c023b86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.516896:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c023b86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.516904:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b6d5230f600) 00010000:00010000:1.0:1782480742.516906:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480742.516909:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c023b86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.516916:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c023b86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.516955:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d800/0x3dc3ebf33c023b78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f800 expref: 8 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.516969:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023b8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f800 expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.516976:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d5230f500) 00010000:00010000:1.0:1782480742.516979:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782480742.516985:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573a00, rc 0) 00000100:00100000:1.0:1782480742.517053:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+7:9679:x1869066291660288:12345-192.168.204.51@tcp:101:touch.500 Request processed in 37727us (38560us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480742.517063:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:2.0:1782480742.522734:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480742.522850:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291660800 00000100:00100000:3.0:1782480742.522860:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291660800 00000100:00100000:3.0:1782480742.522918:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:3.0:1782480742.522929:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+7:9679:x1869066291660800:12345-192.168.204.51@tcp:101:touch.500 00010000:00010000:3.0:1782480742.522953:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480742.522974:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ece00/0x3dc3ebf33c023b94 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f807 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.523311:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023b9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.523326:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023b9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.523336:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023b9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.523394:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ba2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.523402:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ba2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.523409:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ba2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782480742.525882:0:5807:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1782480742.526246:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023ba9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.526265:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.526287:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023ba9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.526327:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023b9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.526335:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023b9b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.526341:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023b9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.526348:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821eda00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480742.526352:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023b9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.526360:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023b9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.526371:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d5230f500) 00010000:00010000:3.0:1782480742.526374:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480742.526379:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023b9b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.526385:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023b9b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782480742.526407:0:5807:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad010b0c reply state 00000000cc481ddf transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ba2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480742.526416:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782480742.526800:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ece00/0x3dc3ebf33c023b94 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f807 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.526817:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f807 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.526825:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b6d4bddcc00) 00010000:00010000:3.0:1782480742.526828:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480742.526831:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ecc00, rc 0) 00000100:00100000:3.0:1782480742.526918:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+10:9679:x1869066291660800:12345-192.168.204.51@tcp:101:touch.500 Request processed in 3989us (4348us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1782480742.526928:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00010000:00010000:1.0:1782480742.528373:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ba2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.528386:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ba2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.528395:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ba2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.528401:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821edc00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480742.528407:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ba2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.528413:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ba2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.528425:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4e7fad3 (ffff9b6d4bddcf00) 00010000:00010000:1.0:1782480742.528428:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480742.528432:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ba2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.528438:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ba2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480742.530164:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480742.530221:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291661056 00000100:00100000:3.0:1782480742.530230:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291661056 00000100:00100000:3.0:1782480742.530302:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:3.0:1782480742.530312:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+9:9679:x1869066291661056:12345-192.168.204.51@tcp:36:touch.500 00010000:00010000:3.0:1782480742.530368:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480742.530393:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023ba9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f807 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.530411:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b6d4bddcc00) 00010000:00010000:3.0:1782480742.530420:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480742.530823:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023bb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.530838:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.530848:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782480742.530990:0:5809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000024caee8a reply state 000000002af89407 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480742.531000:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782480742.531098:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+10:9679:x1869066291661056:12345-192.168.204.51@tcp:36:touch.500 Request processed in 786us (941us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1782480742.531105:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:0.0:1782480742.535514:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480742.535734:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291661184 00000100:00100000:1.0:1782480742.535771:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291661184 00000100:00100000:1.0:1782480742.535837:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:1.0:1782480742.535846:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+10:9679:x1869066291661184:12345-192.168.204.51@tcp:101:touch.500 00010000:00010000:1.0:1782480742.535884:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480742.535905:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023bbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f80e expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.535973:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023bbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f80e expref: 11 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.535989:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023bbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f80e expref: 11 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.536010:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b6d43255f00) 00010000:00010000:1.0:1782480742.536013:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782480742.536017:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573800, rc 0) 00000100:00100000:1.0:1782480742.536091:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+11:9679:x1869066291661184:12345-192.168.204.51@tcp:101:touch.500 Request processed in 246us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480742.536099:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00010000:00010000:3.0:1782480742.536215:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.536225:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023bb7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.536232:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023bb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.536238:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480742.536242:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023bb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.536249:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023bb7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.536260:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b6d43255f00) 00010000:00010000:3.0:1782480742.536263:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480742.536276:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023bb7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.536283:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023bb7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480742.539079:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480742.539154:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291661312 00000100:00100000:3.0:1782480742.539164:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291661312 00000100:00100000:3.0:1782480742.539228:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:3.0:1782480742.539237:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2365:x1869066291661312:12345-192.168.204.51@tcp:8:touch.500 00010000:00080000:3.0:1782480742.539281:0:6602:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp t0 exp 0000000000000000 cur 363 last 0 00000020:00000080:3.0:1782480742.539314:0:6602:0:(genops.c:1406:class_connect()) connect: client 49099535-dcd3-436f-aa96-9770a3f52e5b, cookie 0x3dc3ebf33c023bc5 00002000:00100000:3.0:1782480742.539327:0:6602:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 49099535-dcd3-436f-aa96-9770a3f52e5b/ffff9b6d74f3c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211365f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782480742.539362:0:6602:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782480742.539646:0:6602:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782480742.539681:0:6602:0:(import.c:65:import_set_state_nolock()) ffff9b6d74f3d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782480742.539790:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f129c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2365:x1869066291661312:12345-192.168.204.51@tcp:8:touch.500 Request processed in 553us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480742.539798:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:0.0:1782480742.543153:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480742.543963:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291661440 00000100:00100000:3.0:1782480742.543975:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291661440 00000100:00100000:3.0:1782480742.544052:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:3.0:1782480742.544064:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+6:0:x1869066291661440:12345-192.168.204.51@tcp:2:touch.500 00000100:00080000:0.0:1782480742.544166:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1782480742.603116:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1782480742.603133:0:7497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 49099535-dcd3-436f-aa96-9770a3f52e5b 00000100:00100000:0.0:1782480742.603325:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+5:0:x1869066291661440:12345-192.168.204.51@tcp:2:touch.500 Request processed in 59256us (60251us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1782480742.603337:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:2.0:1782480742.606719:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480742.607025:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291661696 00000100:00100000:3.0:1782480742.607034:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291661696 00000100:00100000:3.0:1782480742.607130:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:3.0:1782480742.607142:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+10:9679:x1869066291661696:12345-192.168.204.51@tcp:35:touch.500 00000100:00100000:3.0:1782480742.607521:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+11:9679:x1869066291661696:12345-192.168.204.51@tcp:35:touch.500 Request processed in 380us (811us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1782480742.607529:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:1.0:1782480742.620083:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480742.620170:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291661824 00000100:00100000:2.0:1782480742.620181:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291661824 00000100:00100000:2.0:1782480742.620243:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:2.0:1782480742.620254:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+11:9680:x1869066291661824:12345-192.168.204.51@tcp:101:rm.0 00010000:00010000:2.0:1782480742.620294:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480742.620314:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c800/0x3dc3ebf33c023bcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f815 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.620378:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c400/0x3dc3ebf33c023bd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.620408:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c400/0x3dc3ebf33c023bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.620429:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c400/0x3dc3ebf33c023bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480742.620500:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782480742.620504:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480742.620560:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c400/0x3dc3ebf33c023bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.620590:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c800/0x3dc3ebf33c023bcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f815 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.620608:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c400/0x3dc3ebf33c023bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f815 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.620616:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d5230f500) 00010000:00010000:2.0:1782480742.620619:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782480742.620623:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6873c400, rc 0) 00000100:00100000:2.0:1782480742.620686:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+12:9680:x1869066291661824:12345-192.168.204.51@tcp:101:rm.0 Request processed in 433us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480742.620694:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:0.0:1782480742.624804:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480742.624908:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291662080 00000100:00100000:1.0:1782480742.624926:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291662080 00000100:00100000:1.0:1782480742.624981:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:1.0:1782480742.624992:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+12:9680:x1869066291662080:12345-192.168.204.51@tcp:101:rm.0 00010000:00010000:1.0:1782480742.625018:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480742.625040:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023bda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f81c expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480742.625187:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1782480742.625363:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023bda lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f81c expref: 14 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.625378:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddc500) 00010000:00010000:1.0:1782480742.625381:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782480742.625387:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023bda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f81c expref: 14 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.625402:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572000, rc 0) 00000100:00100000:1.0:1782480742.625480:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+13:9680:x1869066291662080:12345-192.168.204.51@tcp:101:rm.0 Request processed in 490us (685us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1782480742.625488:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:3.0:1782480742.638978:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480742.639644:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291662208 00000100:00100000:2.0:1782480742.639655:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291662208 00000100:00100000:2.0:1782480742.639721:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:2.0:1782480742.639732:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+13:9680:x1869066291662208:12345-192.168.204.51@tcp:37:rm.0 00000100:00100000:2.0:1782480742.660314:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+13:9680:x1869066291662208:12345-192.168.204.51@tcp:37:rm.0 Request processed in 20569us (21331us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480742.660339:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:1.0:1782480742.671155:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480742.671352:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291662464 00000100:00100000:3.0:1782480742.671363:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291662464 00000100:00100000:3.0:1782480742.671417:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:3.0:1782480742.671438:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473b4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+13:9680:x1869066291662464:12345-192.168.204.51@tcp:35:rm.0 00000100:00100000:3.0:1782480742.671872:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473b4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+14:9680:x1869066291662464:12345-192.168.204.51@tcp:35:rm.0 Request processed in 433us (726us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1782480742.671881:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:3.0:1782480742.676082:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480742.676259:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291662720 00000100:00100000:2.0:1782480742.676279:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291662720 00000100:00100000:2.0:1782480742.676344:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:2.0:1782480742.676355:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+14:9680:x1869066291662720:12345-192.168.204.51@tcp:101:rm.0 00010000:00010000:2.0:1782480742.676379:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480742.676398:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c800/0x3dc3ebf33c023be8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f823 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.676695:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c200/0x3dc3ebf33c023bef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.676711:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c200/0x3dc3ebf33c023bef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.676723:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c200/0x3dc3ebf33c023bef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480742.676735:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1782480742.677226:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c800/0x3dc3ebf33c023be8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f823 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.677248:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c200/0x3dc3ebf33c023bef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f823 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.677257:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d5230f500) 00010000:00010000:2.0:1782480742.677260:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782480742.677273:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6873c200, rc 0) 00000100:00100000:2.0:1782480742.677401:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+16:9680:x1869066291662720:12345-192.168.204.51@tcp:101:rm.0 Request processed in 1048us (1327us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1782480742.677411:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:1.0:1782480742.681043:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480742.681144:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291662848 00000100:00100000:0.0:1782480742.681153:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291662848 00000100:00100000:0.0:1782480742.681240:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:0.0:1782480742.681250:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+16:9680:x1869066291662848:12345-192.168.204.51@tcp:41:rm.0 00000004:00000024:0.0:1782480742.681321:0:10450:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1782480742.681393:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+16:9680:x1869066291662848:12345-192.168.204.51@tcp:41:rm.0 Request processed in 144us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480742.681401:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:1.0:1782480742.683406:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480742.684078:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291662976 00000100:00100000:2.0:1782480742.684088:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291662976 00000100:00100000:2.0:1782480742.684147:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:2.0:1782480742.684158:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+16:9680:x1869066291662976:12345-192.168.204.51@tcp:101:rm.0 00010000:00010000:2.0:1782480742.684180:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480742.684202:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873da00/0x3dc3ebf33c023bfd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f82a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684287:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c000/0x3dc3ebf33c023c04 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684303:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c000/0x3dc3ebf33c023c04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684315:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c000/0x3dc3ebf33c023c04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684327:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873d000/0x3dc3ebf33c023c0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684333:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873d000/0x3dc3ebf33c023c0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684339:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873d000/0x3dc3ebf33c023c0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684639:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873dc00/0x3dc3ebf33c023c12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684661:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873dc00/0x3dc3ebf33c023c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684669:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873dc00/0x3dc3ebf33c023c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480742.684701:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782480742.684705:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480742.684722:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873dc00/0x3dc3ebf33c023c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684733:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873dc00/0x3dc3ebf33c023c12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684742:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c000/0x3dc3ebf33c023c04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684780:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c000/0x3dc3ebf33c023c04 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684786:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c000/0x3dc3ebf33c023c04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684791:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6873c000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480742.684795:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c000/0x3dc3ebf33c023c04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684802:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c000/0x3dc3ebf33c023c04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684815:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d5230f500) 00010000:00010000:2.0:1782480742.684818:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480742.684829:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c000/0x3dc3ebf33c023c04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684836:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c000/0x3dc3ebf33c023c04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684851:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873d000/0x3dc3ebf33c023c0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684857:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873d000/0x3dc3ebf33c023c0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684862:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873d000/0x3dc3ebf33c023c0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684867:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6873d000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480742.684870:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873d000/0x3dc3ebf33c023c0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684875:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873d000/0x3dc3ebf33c023c0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684883:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4e7fad3 (ffff9b6d45d62700) 00010000:00010000:2.0:1782480742.684885:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480742.684888:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873d000/0x3dc3ebf33c023c0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684893:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873d000/0x3dc3ebf33c023c0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684924:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873da00/0x3dc3ebf33c023bfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f82a expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684951:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873dc00/0x3dc3ebf33c023c12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f82a expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.684958:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b6d43255f00) 00010000:00010000:2.0:1782480742.684961:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782480742.684963:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6873dc00, rc 0) 00000100:00100000:2.0:1782480742.685023:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+17:9680:x1869066291662976:12345-192.168.204.51@tcp:101:rm.0 Request processed in 866us (1626us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480742.685031:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:3.0:1782480742.688832:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480742.689012:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291663232 00000100:00100000:2.0:1782480742.689024:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291663232 00000100:00100000:2.0:1782480742.689068:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:2.0:1782480742.689077:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+17:9680:x1869066291663232:12345-192.168.204.51@tcp:36:rm.0 00010000:00010000:2.0:1782480742.689136:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782480742.689164:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873dc00/0x3dc3ebf33c023c12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f82a expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.689187:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023bbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f80e expref: 16 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.689198:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b6d43255f00) 00010000:00010000:2.0:1782480742.689212:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c400/0x3dc3ebf33c023bd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f815 expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.689222:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d5230f500) 00010000:00010000:2.0:1782480742.689237:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782480742.689256:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c600/0x3dc3ebf33c023c19 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.689281:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c600/0x3dc3ebf33c023c19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.689291:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c600/0x3dc3ebf33c023c19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.689321:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c023c20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.689329:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c023c20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.689336:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c023c20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.689495:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023c27 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.689503:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023c27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.689511:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023c27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782480742.695212:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1782480742.695233:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 363536484847ns, next at 364536481597ns, rc = 0 00010000:00010000:2.0:1782480742.695330:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c023c2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.695362:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c023c2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.695374:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c023c2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.695384:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c023c2e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.695390:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c023c2e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.695397:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c023c2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.695494:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782480742.695518:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023c27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.695525:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023c27 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.695541:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023c27 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.695547:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9e00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480742.695553:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023c27 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.695561:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023c27 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.695584:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b6d45d62e00) 00010000:00010000:2.0:1782480742.695587:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782480742.695592:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023c27 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.695597:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023c27 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.695614:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c600/0x3dc3ebf33c023c19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.695620:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c600/0x3dc3ebf33c023c19 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.695626:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c600/0x3dc3ebf33c023c19 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.695632:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6873c600 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480742.695634:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c600/0x3dc3ebf33c023c19 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.695640:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c600/0x3dc3ebf33c023c19 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.695648:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d5230f500) 00010000:00010000:2.0:1782480742.695650:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480742.695653:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c600/0x3dc3ebf33c023c19 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.695659:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c600/0x3dc3ebf33c023c19 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480742.695679:0:5809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f7da7d9b reply state 00000000da145052 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c023c20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480742.695688:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782480742.695804:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+16:9680:x1869066291663232:12345-192.168.204.51@tcp:36:rm.0 Request processed in 6722us (6979us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1782480742.695814:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 30 00010000:00010000:3.0:1782480742.696520:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480742.696538:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c023c2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.696547:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9800 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:3.0:1782480742.696550:0:7486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c023c2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.696558:0:7486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c023c2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.696570:0:7486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b6d45d62e00) 00010000:00010000:3.0:1782480742.696573:0:7486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782480742.696576:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c023c2e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.696582:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c023c2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.696599:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480742.696601:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480742.696603:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480742.705800:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00010000:00010000:2.0:1782480742.706135:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c023c20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.706148:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c023c20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.706155:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c023c20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.706161:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480742.706166:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c023c20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.706174:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c023c20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.706192:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4e7fad3 (ffff9b6d45d62600) 00010000:00010000:2.0:1782480742.706195:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480742.706201:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c023c20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480742.706207:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c023c20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4e7fad3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480742.706357:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291663488 00000100:00100000:3.0:1782480742.706367:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291663488 00000100:00100000:3.0:1782480742.706431:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:3.0:1782480742.706441:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+15:9680:x1869066291663488:12345-192.168.204.51@tcp:35:rm.0 00000100:00100000:3.0:1782480742.706727:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+16:9680:x1869066291663488:12345-192.168.204.51@tcp:35:rm.0 Request processed in 286us (936us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1782480742.706735:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:1.0:1782480742.709569:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480742.709719:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291663744 00000100:00100000:0.0:1782480742.709729:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291663744 00000100:00100000:0.0:1782480742.709806:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:0.0:1782480742.709817:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+16:9680:x1869066291663744:12345-192.168.204.51@tcp:36:rm.0 00010000:00010000:0.0:1782480742.709879:0:10450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782480742.709914:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6873c200/0x3dc3ebf33c023bef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f823 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.709945:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023b8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f800 expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.709955:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d5230f500) 00010000:00010000:0.0:1782480742.709984:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023b4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7f2 expref: 14 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.709994:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddc500) 00010000:00010000:0.0:1782480742.710001:0:10450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480742.710024:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c023c35 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.710035:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c023c35 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.710044:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c023c35 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.710057:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c023c3c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.710064:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c023c3c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.710070:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c023c3c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.710369:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023c43 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.710377:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023c43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480742.710384:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023c43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480742.720124:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1782480742.720165:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023c43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.720176:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023c43 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.720184:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023c43 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.720200:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480742.720206:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023c43 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.720213:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023c43 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.720229:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b6d43255d00) 00010000:00010000:1.0:1782480742.720232:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782480742.720237:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023c43 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.720243:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023c43 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.720280:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c023c35 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.720287:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c023c35 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.720293:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c023c35 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.720297:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c600 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480742.720300:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c023c35 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.720305:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c023c35 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.720323:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d43255e00) 00010000:00010000:1.0:1782480742.720325:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480742.720328:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c023c35 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480742.720334:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c023c35 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782480742.720348:0:10450:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001e120945 reply state 00000000a37272dd transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c023c3c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480742.720357:0:10450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782480742.720470:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+15:9680:x1869066291663744:12345-192.168.204.51@tcp:36:rm.0 Request processed in 10650us (10905us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1782480742.720478:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00010000:00010000:3.0:1782480742.722469:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c023c3c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.722485:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c023c3c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.722492:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c023c3c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.722498:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2ca00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480742.722503:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c023c3c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.722510:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c023c3c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.722537:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b6d43255500) 00010000:00010000:3.0:1782480742.722541:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480742.722546:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c023c3c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480742.722553:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c023c3c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480743.094985:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480744.119054:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480745.142855:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480745.212814:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311618944:0@lo:400:kworker.0 00000100:00100000:3.0:1782480745.212892:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480745.213093:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311618944 00000100:00100000:2.0:1782480745.213101:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311618944 00000100:00100000:2.0:1782480745.213151:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1782480745.213161:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3318:x1869066311618944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480745.215027:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311619328:0@lo:400:kworker.0 00000100:00100000:1.0:1782480745.215088:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480745.215121:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782480745.215127:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311619456:0@lo:400:kworker.0 00000100:00100000:1.0:1782480745.215150:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480745.215175:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311619072:0@lo:400:kworker.0 00000100:00100000:1.0:1782480745.215195:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480745.215209:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311619584:0@lo:400:kworker.0 00000100:00100000:1.0:1782480745.215250:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480745.215267:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782480745.215273:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7591f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311619200:0@lo:400:kworker.0 00000100:00100000:1.0:1782480745.215292:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480745.215336:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311619328 00000100:00100000:1.0:1782480745.215342:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311619328 00000100:00100000:1.0:1782480745.215398:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311619584 00000100:00100000:1.0:1782480745.215401:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311619584 00000100:00100000:0.0:1782480745.215415:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782480745.215430:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311619328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480745.215489:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311619328:12345-0@lo:400:kworker.0 Request processed in 60us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480745.217091:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782480745.217110:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311619584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480745.217176:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311619584:12345-0@lo:400:kworker.0 Request processed in 76us (1926us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480745.217183:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782480745.217213:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311619456 00000100:00100000:1.0:1782480745.217232:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311619456 00000100:00100000:1.0:1782480745.217409:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311619072 00000100:00100000:1.0:1782480745.217414:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311619072 00000100:00100000:1.0:1782480745.217428:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311619200 00000100:00100000:1.0:1782480745.217430:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311619200 00000100:00100000:1.0:1782480745.217445:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782480745.217450:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311619456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480745.217482:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311619456:12345-0@lo:400:kworker.0 Request processed in 32us (2331us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480745.217488:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1782480745.217498:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782480745.217504:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311619072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480745.217528:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311619072:12345-0@lo:400:kworker.0 Request processed in 25us (2332us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480745.217533:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1782480745.217545:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1782480745.217550:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311619200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480745.217575:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311619200:12345-0@lo:400:kworker.0 Request processed in 25us (2282us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480745.217594:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1782480745.217705:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782480745.217709:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782480745.217712:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480745.217772:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7591f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311619200:0@lo:400:kworker.0 00000100:00100000:1.0:1782480745.217784:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311619072:0@lo:400:kworker.0 00010000:00080000:1.0:1782480745.217796:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d75542d80 x1869066311619584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480745.217806:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311619584:0@lo:400:kworker.0 00000100:00100000:1.0:1782480745.217847:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311619456:0@lo:400:kworker.0 00010000:00080000:1.0:1782480745.217859:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d75543480 x1869066311619328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480745.217867:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311619328:0@lo:400:kworker.0 00000100:00100000:0.0:1782480745.218084:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782480745.223963:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3318:x1869066311618944:12345-0@lo:400:kworker.0 Request processed in 10795us (11063us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480745.223980:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1782480745.225686:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311618944:0@lo:400:kworker.0 00000100:00100000:3.0:1782480745.719013:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:0.0:1782480745.719058:0:7923:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366560309539ns, next at 367560307051ns, rc = 0 00000100:00100000:3.0:1782480745.720683:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311619712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480745.720787:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480745.720959:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311619712 00000100:00100000:0.0:1782480745.720967:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311619712 00000100:00100000:0.0:1782480745.721010:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782480745.721019:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311619712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782480745.721056:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480745.721101:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311619712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480745.721108:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1782480745.721234:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d753fb100 x1869066311619712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480745.721252:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311619712:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782480746.166992:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480747.193011:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782480747.210977:0:11472:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:2.0:1782480747.255022:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782480747.257331:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311619840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480747.257551:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480747.261621:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311619840 00000100:00100000:3.0:1782480747.261635:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311619840 00000100:00100000:3.0:1782480747.261701:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782480747.261712:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311619840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480747.261768:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480747.261846:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311619840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (4295us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480747.261854:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1782480747.261902:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f2d5500 x1869066311619840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480747.261924:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311619840:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782480747.262061:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480747.609725:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480747.609815:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480747.609847:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480747.609870:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291664000 00000100:00100000:3.0:1782480747.609881:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291664000 00000100:00100000:1.0:1782480747.609886:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480747.609923:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291664128 00000100:00100000:3.0:1782480747.609945:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291664256 00000100:00100000:3.0:1782480747.609948:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291664256 00000100:00100000:3.0:1782480747.609972:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 102 00000100:00100000:3.0:1782480747.609982:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+14:2368:x1869066291664000:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480747.610028:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291663872 00000100:00100000:0.0:1782480747.610033:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291663872 00000100:00100000:3.0:1782480747.610059:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+14:2368:x1869066291664000:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 78us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480747.610061:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 249 00000100:00100000:3.0:1782480747.610067:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 102 00000100:00100000:0.0:1782480747.610068:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2368:x1869066291663872:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480747.610093:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2368:x1869066291663872:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480747.610094:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 103 00000100:00100000:3.0:1782480747.610100:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2368:x1869066291664256:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480747.610100:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 249 00000100:00100000:3.0:1782480747.610122:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2368:x1869066291664256:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 23us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480747.610129:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 103 00000100:00080000:3.0:1782480747.610143:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480747.610513:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291664128 00000100:00100000:1.0:1782480747.610570:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:1.0:1782480747.610578:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2368:x1869066291664128:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480747.610623:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2368:x1869066291664128:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 47us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480747.610637:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00080000:3.0:1782480747.610701:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1782480747.828337:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1782480747.828364:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000001:00080000:3.0:1782480747.828375:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1782480747.828383:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1782480747.828595:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311619968:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782480747.828660:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480747.828891:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311619968 00000100:00100000:1.0:1782480747.828899:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311619968 00000100:00100000:1.0:1782480747.828962:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782480747.828972:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311619968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782480747.828998:0:8678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1782480747.829030:0:8678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a3e7f67, atime: 0x6a3e7f67, ctime: 0x6a3e7f67, blocks: 0x1 00010000:00010000:1.0:1782480747.829038:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023c4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.829054:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=368s v=(0 0) 00010000:00010000:1.0:1782480747.829059:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480747.829065:0:8678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023c4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.829084:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023c4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.829095:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023c4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.829103:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023c4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.829122:0:8678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782480747.829639:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1869066311619968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 666us (977us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1782480747.829653:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1782480747.829677:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480747.829684:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023c4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.829694:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572a00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480747.829699:0:7486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023c4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.829709:0:7486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023c4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.829726:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023c4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.829735:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023c4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.829780:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480747.829782:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480747.829783:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782480747.829820:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d75543b80/2, rc 0, transno 4294967300 00000100:00100000:1.0:1782480747.829826:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311619968:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1782480747.829893:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782480748.217666:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782480748.432663:0:11523:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc66bb17c0 20000000:00000080:2.0:1782480748.432678:0:11523:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b6d7fc03400 uarg=0000000000000000 20000000:01000000:2.0:1782480748.433008:0:11523:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1782480748.433017:0:11523:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1782480748.433023:0:11523:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1782480748.434004:0:11524:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1782480748.434296:0:11523:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1782480748.443929:0:11523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1782480748.443990:0:11523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1782480748.444046:0:11523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1782480748.444064:0:11523:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782480748.444081:0:11523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d582e9000/0x3dc3ebf33c023c51 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.444099:0:11523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d40030400/0x3dc3ebf33c023af3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023aec expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.444118:0:11523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d40030a00/0x3dc3ebf33c023b01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023afa expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.444124:0:11523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d6e573200/0x3dc3ebf33c023b0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023b08 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.444132:0:11523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d6e573600/0x3dc3ebf33c023b16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7dd expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.444139:0:11523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d6e573000/0x3dc3ebf33c023b1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7e4 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.444146:0:11523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d582e9000/0x3dc3ebf33c023c51 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.444200:0:11523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d6e573000/0x3dc3ebf33c023b1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7e4 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.444215:0:11523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d6e573000/0x3dc3ebf33c023b1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7e4 expref: 12 pid: 5801 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480748.444232:0:11523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b331f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11523:1869066311620096:192.168.204.51@tcp:104: 00010000:00010000:2.0:1782480748.444346:0:11523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d6e573600/0x3dc3ebf33c023b16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7dd expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.444354:0:11523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d6e573600/0x3dc3ebf33c023b16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7dd expref: 12 pid: 5801 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480748.444364:0:11523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b330380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11523:1869066311620224:192.168.204.51@tcp:104: 00010000:00010000:2.0:1782480748.444405:0:11523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d6e573200/0x3dc3ebf33c023b0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c023b08 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.444414:0:11523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d6e573200/0x3dc3ebf33c023b0f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c023b08 expref: 18 pid: 5802 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480748.444423:0:11523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b330700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11523:1869066311620352:0@lo:104: 00000100:00100000:2.0:1782480748.444461:0:11523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782480748.444501:0:11523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d40030a00/0x3dc3ebf33c023b01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c023afa expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.444509:0:11523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d40030a00/0x3dc3ebf33c023b01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c023afa expref: 18 pid: 5799 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480748.444517:0:11523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11523:1869066311620480:0@lo:104: 00000100:00100000:2.0:1782480748.444539:0:11523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480748.444572:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311620352 00000100:00100000:2.0:1782480748.444579:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311620352 00000100:00100000:2.0:1782480748.444617:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311620480 00000100:00100000:2.0:1782480748.444620:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311620480 00000100:00100000:2.0:1782480748.444634:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782480748.444643:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b330e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+4:11523:x1869066311620352:12345-0@lo:104: 00010000:00010000:2.0:1782480748.444655:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d6873cc00/0x3dc3ebf33c023b08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023b0f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.444700:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782480748.444706:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b330e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+4:11523:x1869066311620352:12345-0@lo:104: Request processed in 64us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.444712:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782480748.444734:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782480748.444740:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+3:11523:x1869066311620480:12345-0@lo:104: 00010000:00010000:2.0:1782480748.444771:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d800/0x3dc3ebf33c023afa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023b01 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.444804:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782480748.444809:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+3:11523:x1869066311620480:12345-0@lo:104: Request processed in 69us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.444814:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1782480748.444844:0:11523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d40030400/0x3dc3ebf33c023af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c023aec expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.448082:0:11523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b6d40030400/0x3dc3ebf33c023af3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c023aec expref: 18 pid: 5802 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480748.448101:0:11523:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11523:1869066311620608:0@lo:104: 00000100:00100000:2.0:1782480748.448180:0:11523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480748.448221:0:11523:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d751db000 going to sleep for 11 seconds 00000100:00100000:2.0:1782480748.448248:0:11523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b331f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11523:1869066311620096:192.168.204.51@tcp:104: 00000100:00100000:3.0:1782480748.448249:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480748.448256:0:11523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b330380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11523:1869066311620224:192.168.204.51@tcp:104: 00000100:00100000:2.0:1782480748.448265:0:11523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b330700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11523:1869066311620352:0@lo:104: 00000100:00100000:2.0:1782480748.448272:0:11523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11523:1869066311620480:0@lo:104: 00000100:00100000:3.0:1782480748.448298:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480748.448467:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782480748.448483:0:5791:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311620608 00000100:00100000:0.0:1782480748.448489:0:5791:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311620608 00000100:00100000:0.0:1782480748.448551:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782480748.448561:0:5791:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7552b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+3:11523:x1869066311620608:12345-0@lo:104: 00010000:00010000:0.0:1782480748.448577:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023af3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480748.448648:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1782480748.448655:0:5791:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7552b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7fffafe6-aedd-4500-93d4-974eea0c11af+3:11523:x1869066311620608:12345-0@lo:104: Request processed in 96us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480748.448662:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1782480748.448726:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782480748.448732:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d6873cc00/0x3dc3ebf33c023b08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023b0f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480748.448740:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6873cc00 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:0.0:1782480748.448744:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6873cc00/0x3dc3ebf33c023b08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c023b0f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480748.448783:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d6873cc00/0x3dc3ebf33c023b08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c023b0f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480748.448789:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6873cc00/0x3dc3ebf33c023b08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c023b0f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480748.448794:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782480748.448839:0:5795:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d6873cc00/0x3dc3ebf33c023b08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023b0f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.449053:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782480748.449059:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d800/0x3dc3ebf33c023afa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023b01 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.449066:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6873d800 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:2.0:1782480748.449069:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d800/0x3dc3ebf33c023afa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c023b01 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.449085:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d800/0x3dc3ebf33c023afa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c023b01 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480748.449091:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d800/0x3dc3ebf33c023afa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c023b01 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480748.449096:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782480748.449111:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d800/0x3dc3ebf33c023afa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023b01 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.449118:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782480748.449137:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d800/0x3dc3ebf33c023afa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023b01 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.449144:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d800/0x3dc3ebf33c023afa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023b01 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.449168:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480748.449171:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c023af3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.449177:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ec400 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:2.0:1782480748.449179:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c023af3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.449186:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c023af3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480748.449192:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c023af3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480748.449203:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782480748.449219:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023af3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.449225:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782480748.449232:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023af3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.449238:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d821ec400/0x3dc3ebf33c023aec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023af3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.449248:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480748.449250:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480748.449252:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480748.449286:0:11523:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11523:1869066311620608:0@lo:104: 00010000:00010000:2.0:1782480748.449315:0:11523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d582e9000/0x3dc3ebf33c023c51 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480748.449349:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291664384 00000100:00100000:2.0:1782480748.449353:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291664384 00010000:00010000:2.0:1782480748.449376:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d6e573000/0x3dc3ebf33c023b1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7e4 expref: 13 pid: 5801 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480748.449394:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291664512 00000100:00100000:2.0:1782480748.449396:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291664512 00010000:00010000:2.0:1782480748.449407:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d6e573600/0x3dc3ebf33c023b16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7dd expref: 14 pid: 5801 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480748.449425:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:2.0:1782480748.449432:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+14:2366:x1869066291664384:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480748.449449:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480748.449456:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d6e573000/0x3dc3ebf33c023b1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7e4 expref: 14 pid: 5801 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.449466:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d6e573000/0x3dc3ebf33c023b1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7e4 expref: 14 pid: 5801 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.449479:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d6e573000/0x3dc3ebf33c023b1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7e4 expref: 14 pid: 5801 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.449490:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480748.449529:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2366:x1869066291664384:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 97us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.449536:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:2.0:1782480748.449552:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:2.0:1782480748.449557:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:2366:x1869066291664512:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480748.449564:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480748.449569:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d6e573600/0x3dc3ebf33c023b16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7dd expref: 12 pid: 5801 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.449577:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d6e573600/0x3dc3ebf33c023b16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7dd expref: 12 pid: 5801 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.449586:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d6e573600/0x3dc3ebf33c023b16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7dd expref: 12 pid: 5801 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.449594:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480748.449611:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+11:2366:x1869066291664512:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 53us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.449623:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00010000:00010000:2.0:1782480748.449642:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480748.449786:0:5795:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480748.449816:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d6873cc00/0x3dc3ebf33c023b08 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023b0f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480748.449823:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d6873cc00/0x3dc3ebf33c023b08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c023b0f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480748.449976:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480748.449979:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480748.449980:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480748.449995:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311620736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480748.450036:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480748.450087:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311620736 00000100:00100000:0.0:1782480748.450092:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311620736 00010000:00010000:0.0:1782480748.450110:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d6e573200/0x3dc3ebf33c023b0f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023b08 expref: 19 pid: 5802 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480748.450128:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782480748.450134:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d465fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3317:x1869066311620736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782480748.450142:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480748.450147:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d6e573200/0x3dc3ebf33c023b0f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023b08 expref: 19 pid: 5802 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480748.450169:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d6e573200/0x3dc3ebf33c023b0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c023b08 expref: 19 pid: 5802 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480748.450181:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d6e573200/0x3dc3ebf33c023b0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c023b08 expref: 19 pid: 5802 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480748.450190:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480748.450218:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d465fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+18:3317:x1869066311620736:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480748.450223:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782480748.450274:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311620736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782480748.450777:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311620864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782480748.450823:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480748.450867:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480748.450874:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311620992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782480748.450896:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480748.450921:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311620864 00000100:00100000:3.0:1782480748.450925:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311620864 00010000:00010000:3.0:1782480748.450945:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d40030a00/0x3dc3ebf33c023b01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023afa expref: 18 pid: 5799 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480748.450975:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311620992 00000100:00100000:3.0:1782480748.450978:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311620992 00010000:00010000:3.0:1782480748.450991:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d40030400/0x3dc3ebf33c023af3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023aec expref: 19 pid: 5802 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480748.451002:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782480748.451007:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311620864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782480748.451015:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480748.451019:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d40030a00/0x3dc3ebf33c023b01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023afa expref: 19 pid: 5799 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480748.451028:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d40030a00/0x3dc3ebf33c023b01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c023afa expref: 19 pid: 5799 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480748.451040:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40030a00/0x3dc3ebf33c023b01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c023afa expref: 19 pid: 5799 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480748.451052:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480748.451080:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fffafe6-aedd-4500-93d4-974eea0c11af+18:3315:x1869066311620864:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480748.451087:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782480748.451101:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782480748.451107:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fffafe6-aedd-4500-93d4-974eea0c11af+17:3315:x1869066311620992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782480748.451114:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480748.451118:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d40030400/0x3dc3ebf33c023af3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c023aec expref: 17 pid: 5802 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480748.451127:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d40030400/0x3dc3ebf33c023af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c023aec expref: 17 pid: 5802 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480748.451145:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40030400/0x3dc3ebf33c023af3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c023aec expref: 17 pid: 5802 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480748.451167:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d582e9000/0x3dc3ebf33c023c51 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480748.451174:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d582e9000/0x3dc3ebf33c023c51 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480748.451188:0:8304:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d582e9000/0x3dc3ebf33c023c51 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480748.451195:0:8304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d582e9000/0x3dc3ebf33c023c51 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480748.451202:0:8304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d582e9000/0x3dc3ebf33c023c51 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480748.451209:0:8304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d582e9000/0x3dc3ebf33c023c51 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480748.451215:0:8304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9000 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:3.0:1782480748.451218:0:8304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d582e9000/0x3dc3ebf33c023c51 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480748.451225:0:8304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d582e9000/0x3dc3ebf33c023c51 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480748.451239:0:8304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d582e9000/0x3dc3ebf33c023c51 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480748.451258:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480748.451281:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fffafe6-aedd-4500-93d4-974eea0c11af+16:3315:x1869066311620992:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480748.451287:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782480748.451322:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311620992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782480748.451329:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311620864:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782480748.452202:0:11523:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d582e9000/0x3dc3ebf33c023c51 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480748.452214:0:11523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d582e9000/0x3dc3ebf33c023c51 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480748.452221:0:11523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d582e9000/0x3dc3ebf33c023c51 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.239086:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480749.527921:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480749.528035:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291664640 00000100:00100000:2.0:1782480749.528046:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291664640 00000100:00100000:2.0:1782480749.528105:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 250 00000100:00100000:2.0:1782480749.528115:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+11:5584:x1869066291664640:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480749.528143:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480749.528163:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d582e8600/0x3dc3ebf33c023c58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f831 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.528190:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d582e8600/0x3dc3ebf33c023c58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f831 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.528200:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d582e8600/0x3dc3ebf33c023c58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f831 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.528209:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e8600, rc 0) 00000100:00100000:2.0:1782480749.528267:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:5584:x1869066291664640:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 153us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480749.528274:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 250 00000100:00100000:2.0:1782480749.531918:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480749.532015:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291664768 00000100:00100000:0.0:1782480749.532025:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291664768 00000100:00100000:0.0:1782480749.532073:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 251 00000100:00100000:0.0:1782480749.532082:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:5584:x1869066291664768:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480749.532354:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:5584:x1869066291664768:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 271us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480749.532362:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 251 00000100:00100000:3.0:1782480749.543636:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480749.543790:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291664896 00000100:00100000:0.0:1782480749.543801:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291664896 00000100:00100000:0.0:1782480749.543859:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 252 00000100:00100000:0.0:1782480749.543869:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:5584:x1869066291664896:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782480749.544089:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:5584:x1869066291664896:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 221us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480749.544098:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 252 00000100:00100000:3.0:1782480749.547918:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480749.551727:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291665024 00000100:00100000:2.0:1782480749.551742:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291665024 00000100:00100000:2.0:1782480749.551897:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 253 00000100:00100000:2.0:1782480749.551908:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:9950:x1869066291665024:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782480749.553454:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:9950:x1869066291665024:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 1540us (5537us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480749.553481:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 253 00000100:00100000:2.0:1782480749.566860:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480749.566976:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291665152 00000100:00100000:1.0:1782480749.566985:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291665152 00000100:00100000:1.0:1782480749.567038:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 254 00000100:00100000:1.0:1782480749.567047:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:9950:x1869066291665152:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782480749.567290:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:9950:x1869066291665152:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 234us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480749.567299:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 254 00000100:00100000:3.0:1782480749.572603:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480749.572727:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291665280 00000100:00100000:2.0:1782480749.572738:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291665280 00000100:00100000:2.0:1782480749.572823:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 255 00000100:00100000:2.0:1782480749.572832:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:5584:x1869066291665280:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480749.572850:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480749.572867:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d582e8c00/0x3dc3ebf33c023c5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f838 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.572999:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d582e8c00/0x3dc3ebf33c023c5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f838 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.573011:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d582e8c00/0x3dc3ebf33c023c5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f838 expref: 13 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.573020:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e8c00, rc 0) 00000100:00100000:2.0:1782480749.573145:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:5584:x1869066291665280:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 313us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480749.573152:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 255 00000100:00100000:3.0:1782480749.588679:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480749.588832:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291665408 00000100:00100000:0.0:1782480749.588842:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291665408 00000100:00100000:0.0:1782480749.588906:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 256 00000100:00100000:0.0:1782480749.588916:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:5584:x1869066291665408:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480749.589210:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:5584:x1869066291665408:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 295us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480749.589218:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 256 00000100:00100000:0.0:1782480749.591347:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480749.591532:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291665536 00000100:00100000:2.0:1782480749.591542:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291665536 00000100:00100000:2.0:1782480749.591594:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 257 00000100:00100000:2.0:1782480749.591604:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:5584:x1869066291665536:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480749.591851:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:5584:x1869066291665536:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 247us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480749.591869:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 257 00000100:00100000:3.0:1782480749.602035:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480749.602626:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291665664 00000100:00100000:1.0:1782480749.602637:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291665664 00000100:00100000:1.0:1782480749.602694:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 258 00000100:00100000:1.0:1782480749.602705:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:9953:x1869066291665664:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782480749.602981:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:9953:x1869066291665664:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 276us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480749.602989:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 258 00000100:00100000:3.0:1782480749.607944:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480749.608046:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291665792 00000100:00100000:0.0:1782480749.608056:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291665792 00000100:00100000:0.0:1782480749.608115:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 259 00000100:00100000:0.0:1782480749.608150:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:9953:x1869066291665792:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782480749.608400:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:9953:x1869066291665792:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 247us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480749.608411:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 259 10000000:01000000:2.0:1782480750.007663:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782480750.007671:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9b6d7581c000 from 7 10000000:01000000:2.0:1782480750.007676:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782480750.007724:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8000/0x3dc3ebf33c023c66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480750.007735:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8000/0x3dc3ebf33c023c66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480750.007760:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8000/0x3dc3ebf33c023c66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480750.007787:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311621120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782480750.007862:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480750.007936:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d751dbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782480750.008102:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311621120 00000100:00100000:3.0:1782480750.008111:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311621120 00000100:00100000:3.0:1782480750.008173:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1782480750.008183:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+16:5804:x1869066311621120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480750.008211:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480750.008223:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d821ece00/0x3dc3ebf33c023c6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023c66 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480750.008246:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d821ece00/0x3dc3ebf33c023c6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023c66 expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480750.008257:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d821ece00/0x3dc3ebf33c023c6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023c66 expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480750.008266:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ece00, rc 0) 00000100:00100000:3.0:1782480750.008313:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311621120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480750.008320:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1782480750.011741:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311621120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480750.011796:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8000/0x3dc3ebf33c023c66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023c6d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480750.011809:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8000/0x3dc3ebf33c023c66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023c6d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480750.011901:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311621248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480750.011959:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480750.012006:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d751dbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782480750.012079:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311621248 00000100:00100000:1.0:1782480750.012086:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311621248 00000100:00100000:1.0:1782480750.012143:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1782480750.012153:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311621248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480750.012415:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311621248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480750.012423:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1782480750.012699:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311621248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480750.012770:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311621376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480750.012810:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480750.012854:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d751dbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1782480750.012916:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311621376 00000100:00100000:0.0:1782480750.012921:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311621376 00000100:00100000:0.0:1782480750.012956:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1782480750.012963:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311621376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782480750.013113:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311621376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480750.013130:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1782480750.013446:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311621376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480750.013850:0:11536:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75542300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:11536:1869066311621504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480750.013886:0:11536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480750.013912:0:11536:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7b17c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480750.014049:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311621504 00000100:00100000:3.0:1782480750.014054:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311621504 00000100:00100000:3.0:1782480750.014092:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1782480750.014100:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+17:11536:x1869066311621504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480750.014269:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+17:11536:x1869066311621504:12345-0@lo:502:llog_process_th.0 Request processed in 170us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480750.014276:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1782480750.014395:0:11536:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75542300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:11536:1869066311621504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782480750.014417:0:11536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782480750.014427:0:11536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480750.014429:0:11536:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782480750.014435:0:11536:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b6d7581c000 00000020:00000080:1.0:1782480750.014442:0:11536:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782480750.014521:0:11536:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75542300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:11536:1869066311621632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480750.014554:0:11536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480750.014589:0:11536:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7b17c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480750.016328:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311621632 00000100:00100000:2.0:1782480750.016337:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311621632 00000100:00100000:2.0:1782480750.016392:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1782480750.016401:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d59946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+17:11536:x1869066311621632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480750.016638:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d59946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+17:11536:x1869066311621632:12345-0@lo:502:llog_process_th.0 Request processed in 237us (2082us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480750.016645:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1782480750.022705:0:11536:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75542300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:11536:1869066311621632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782480750.022772:0:11536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480750.022781:0:11536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480750.022783:0:11536:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1782480750.022787:0:11536:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1782480750.022963:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1782480750.022981:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782480750.022993:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8000/0x3dc3ebf33c023c66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023c6d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480750.023005:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8000/0x3dc3ebf33c023c66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023c6d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480750.023015:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782480750.023017:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9b6d46055800 from 7 10000000:01000000:2.0:1782480750.023020:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782480750.023052:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9c00/0x3dc3ebf33c023c74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480750.023060:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9c00/0x3dc3ebf33c023c74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480750.023082:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9c00/0x3dc3ebf33c023c74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480750.023102:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311621760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782480750.023173:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480750.023216:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d751db180 going to sleep for 11 seconds 00000100:00100000:1.0:1782480750.026205:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311621760 00000100:00100000:1.0:1782480750.026217:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311621760 00000100:00100000:1.0:1782480750.026265:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1782480750.026274:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d5a19c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+17:5804:x1869066311621760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480750.026291:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480750.026306:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d6e573400/0x3dc3ebf33c023c7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023c74 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480750.026331:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d6e573400/0x3dc3ebf33c023c7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023c74 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480750.026342:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d6e573400/0x3dc3ebf33c023c7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023c74 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480750.026351:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573400, rc 0) 00000100:00100000:1.0:1782480750.026410:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d5a19c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311621760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (3238us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480750.026416:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1782480750.026616:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311621760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480750.026633:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9c00/0x3dc3ebf33c023c74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023c7b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480750.026642:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9c00/0x3dc3ebf33c023c74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023c7b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480750.026703:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311621888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480750.026734:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480750.026792:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d751db180 going to sleep for 11 seconds 00000100:00100000:1.0:1782480750.027002:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311621888 00000100:00100000:1.0:1782480750.027015:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311621888 00000100:00100000:1.0:1782480750.027050:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1782480750.027057:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311621888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480750.027309:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311621888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480750.027316:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1782480750.027928:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311621888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480750.027971:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311622016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480750.028016:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480750.028037:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d751db180 going to sleep for 11 seconds 00000100:00100000:2.0:1782480750.028053:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311622016 00000100:00100000:2.0:1782480750.028057:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311622016 00000100:00100000:2.0:1782480750.028085:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1782480750.028091:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311622016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480750.028249:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311622016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480750.028262:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1782480750.028297:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311622016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480750.028459:0:11539:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:11539:1869066311622144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480750.028491:0:11539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480750.028509:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311622144 00000100:00100000:2.0:1782480750.028512:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311622144 00000100:00100000:2.0:1782480750.028529:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1782480750.028535:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+18:11539:x1869066311622144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480750.028659:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+18:11539:x1869066311622144:12345-0@lo:502:llog_process_th.0 Request processed in 123us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480750.028667:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1782480750.028692:0:11539:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d751db480 going to sleep for 11 seconds 00000100:00100000:2.0:1782480750.028703:0:11539:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:11539:1869066311622144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782480750.028723:0:11539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782480750.028731:0:11539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480750.028733:0:11539:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782480750.028740:0:11539:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b6d46055800 00000020:00000080:2.0:1782480750.028742:0:11539:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782480750.028831:0:11539:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:11539:1869066311622272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480750.028862:0:11539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480750.028880:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311622272 00000100:00100000:2.0:1782480750.028883:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311622272 00000100:00100000:2.0:1782480750.028901:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1782480750.028906:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+18:11539:x1869066311622272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480750.029002:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+18:11539:x1869066311622272:12345-0@lo:502:llog_process_th.0 Request processed in 95us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480750.029013:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1782480750.029040:0:11539:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae50000 going to sleep for 11 seconds 00000100:00100000:2.0:1782480750.029051:0:11539:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:11539:1869066311622272:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782480750.029066:0:11539:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480750.029070:0:11539:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480750.029071:0:11539:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1782480750.029074:0:11539:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1782480750.029129:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1782480750.029144:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782480750.029153:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9c00/0x3dc3ebf33c023c74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023c7b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480750.029162:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9c00/0x3dc3ebf33c023c74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023c7b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480750.029172:0:5804:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782480750.029174:0:5804:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9b6d47c9a800 from 7 10000000:01000000:2.0:1782480750.029177:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782480750.029199:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c023c82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480750.029206:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c023c82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480750.029213:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c023c82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480750.029225:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311622400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782480750.029251:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480750.029269:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae50000 going to sleep for 11 seconds 00000100:00100000:2.0:1782480750.029281:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311622400 00000100:00100000:2.0:1782480750.029284:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311622400 00000100:00100000:2.0:1782480750.029301:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1782480750.029307:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+18:5804:x1869066311622400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480750.029315:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480750.029325:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d582e8e00/0x3dc3ebf33c023c89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c023c82 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480750.029344:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d582e8e00/0x3dc3ebf33c023c89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c023c82 expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480750.029354:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d582e8e00/0x3dc3ebf33c023c89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c023c82 expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480750.029362:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e8e00, rc 0) 00000100:00100000:2.0:1782480750.029389:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311622400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480750.029395:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1782480750.029421:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311622400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480750.029432:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c023c82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023c89 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480750.029440:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c023c82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023c89 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480750.029476:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311622528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480750.029499:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480750.029519:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae50000 going to sleep for 11 seconds 00000100:00100000:2.0:1782480750.029530:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311622528 00000100:00100000:2.0:1782480750.029532:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311622528 00000100:00100000:2.0:1782480750.029548:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1782480750.029553:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311622528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480750.029732:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311622528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480750.029739:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1782480750.029786:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311622528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480750.029808:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311622656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480750.029840:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480750.029851:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae50000 going to sleep for 11 seconds 00000100:00100000:2.0:1782480750.029861:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311622656 00000100:00100000:2.0:1782480750.029864:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311622656 00000100:00100000:2.0:1782480750.029880:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1782480750.029886:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311622656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480750.029985:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:5804:x1869066311622656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480750.029992:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1782480750.030025:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7fffafe6-aedd-4500-93d4-974eea0c11af:5804:1869066311622656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480750.030218:0:11540:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:11540:1869066311622784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480750.030251:0:11540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480750.030269:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311622784 00000100:00100000:2.0:1782480750.030272:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311622784 00000100:00100000:2.0:1782480750.030285:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1782480750.030290:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:11540:x1869066311622784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480750.030402:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:11540:x1869066311622784:12345-0@lo:502:llog_process_th.0 Request processed in 111us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480750.030409:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1782480750.030433:0:11540:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae50000 going to sleep for 11 seconds 00000100:00100000:2.0:1782480750.030445:0:11540:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:11540:1869066311622784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782480750.030463:0:11540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782480750.030470:0:11540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480750.030472:0:11540:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782480750.030478:0:11540:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b6d47c9a800 00000020:00000080:2.0:1782480750.030480:0:11540:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782480750.030527:0:11540:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:11540:1869066311622912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480750.030557:0:11540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480750.030575:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311622912 00000100:00100000:2.0:1782480750.030579:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311622912 00000100:00100000:2.0:1782480750.030592:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1782480750.030598:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:11540:x1869066311622912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480750.030694:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:11540:x1869066311622912:12345-0@lo:502:llog_process_th.0 Request processed in 95us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480750.030700:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1782480750.030725:0:11540:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae50000 going to sleep for 11 seconds 00000100:00100000:2.0:1782480750.030738:0:11540:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7fffafe6-aedd-4500-93d4-974eea0c11af:11540:1869066311622912:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782480750.030775:0:11540:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480750.030779:0:11540:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480750.030780:0:11540:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1782480750.030784:0:11540:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1782480750.030819:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1782480750.030839:0:5804:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782480750.030847:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c023c82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023c89 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480750.030856:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c023c82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023c89 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782480750.045515:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782480750.263092:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480750.327961:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1869066311623296:0@lo:400:kworker.0 00000100:00100000:0.0:1782480750.328027:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480750.328052:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311623424:0@lo:400:kworker.0 00000100:00100000:2.0:1782480750.328094:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480750.328107:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782480750.328127:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311623168:0@lo:400:kworker.0 00000100:00100000:2.0:1782480750.328141:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782480750.328150:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311623040:0@lo:400:kworker.0 00000100:00100000:0.0:1782480750.328173:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480750.328186:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480750.328310:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311623296 00000100:00100000:3.0:1782480750.328318:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311623296 00000100:00100000:3.0:1782480750.328367:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311623168 00000100:00100000:3.0:1782480750.328371:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311623168 00000100:00100000:3.0:1782480750.328396:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782480750.328405:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869066311623296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480750.328479:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1782480750.328489:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311623168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480750.330248:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311623552:0@lo:400:kworker.0 00000100:00100000:2.0:1782480750.330302:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480750.330342:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311623424 00000100:00100000:2.0:1782480750.330349:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311623424 00000100:00100000:2.0:1782480750.330407:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782480750.330415:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311623424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480750.330463:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311623424:12345-0@lo:400:kworker.0 Request processed in 48us (2370us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480750.330471:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782480750.330493:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311623040 00000100:00100000:2.0:1782480750.330497:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311623040 00000100:00100000:2.0:1782480750.330522:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1782480750.330527:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3317:x1869066311623040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480750.330857:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3317:x1869066311623040:12345-0@lo:400:kworker.0 Request processed in 329us (2670us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480750.330876:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1782480750.330904:0:5808:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1782480750.330911:0:5808:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1782480750.331026:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311623040:0@lo:400:kworker.0 00010000:00080000:2.0:1782480750.331041:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d753f8700 x1869066311623424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480750.331053:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311623424:0@lo:400:kworker.0 00000100:00100000:2.0:1782480750.331094:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311623552 00000100:00100000:2.0:1782480750.331098:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311623552 00000100:00100000:2.0:1782480750.331135:0:5808:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1782480750.331143:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782480750.331149:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311623552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480750.331184:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311623552:12345-0@lo:400:kworker.0 Request processed in 35us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480750.331191:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1782480750.331216:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311623552:0@lo:400:kworker.0 00000100:00080000:2.0:1782480750.331350:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782480750.331355:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480750.333021:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311623680:0@lo:400:kworker.0 00000100:00100000:3.0:1782480750.333052:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869066311623296:12345-0@lo:400:kworker.0 Request processed in 4646us (5022us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480750.333064:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1782480750.333988:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480750.334131:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1869066311623296:0@lo:400:kworker.0 00000100:00100000:1.0:1782480750.334492:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311623168:12345-0@lo:400:kworker.0 Request processed in 6003us (6319us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480750.334503:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782480750.334605:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311623168:0@lo:400:kworker.0 00000100:00100000:2.0:1782480750.334823:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311623680 00000100:00100000:2.0:1782480750.334832:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311623680 00000100:00100000:2.0:1782480750.334888:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782480750.334896:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1869066311623680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480750.334966:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1869066311623680:12345-0@lo:400:kworker.0 Request processed in 71us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480750.334973:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782480750.335534:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311623680:0@lo:400:kworker.0 00000100:00080000:3.0:1782480750.335603:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782480750.840319:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480750.840342:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311623808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480750.840423:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480750.840784:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311623808 00000100:00100000:0.0:1782480750.840792:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311623808 00000100:00100000:0.0:1782480750.840846:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782480750.840943:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869066311623808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782480750.840995:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480750.841057:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869066311623808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 203us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480750.841065:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782480750.841198:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311623808:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1782480751.099919:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782480751.287876:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480752.311770:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480752.376058:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782480752.376097:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311623936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480752.376167:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480752.376357:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311623936 00000100:00100000:0.0:1782480752.376365:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311623936 00000100:00100000:0.0:1782480752.376427:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782480752.376436:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311623936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782480752.376470:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480752.376523:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311623936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480752.376529:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1782480752.376602:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782480752.376698:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f2d5c00 x1869066311623936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480752.376718:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311623936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480752.728789:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480752.728834:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480752.728870:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480752.728908:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480752.728988:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291666176 00000100:00100000:2.0:1782480752.728997:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291666176 00000100:00100000:1.0:1782480752.729014:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291665920 00000100:00100000:1.0:1782480752.729018:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291665920 00000100:00100000:2.0:1782480752.729062:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:1.0:1782480752.729062:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 276 00000100:00100000:2.0:1782480752.729082:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2368:x1869066291666176:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480752.729082:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2368:x1869066291665920:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480752.729144:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2368:x1869066291665920:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 74us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480752.729152:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 276 00000100:00100000:3.0:1782480752.729154:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291666048 00000100:00100000:3.0:1782480752.729158:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291666048 00000100:00100000:3.0:1782480752.729184:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291666304 00000100:00100000:3.0:1782480752.729187:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291666304 00000100:00100000:3.0:1782480752.729211:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 107 00000100:00080000:0.0:1782480752.729245:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782480752.729249:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782480752.729343:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2368:x1869066291666048:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480752.732192:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2368:x1869066291666176:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 3111us (3272us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480752.732207:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:1.0:1782480752.734407:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 108 00000100:00100000:1.0:1782480752.734433:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2368:x1869066291666304:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480752.734529:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2368:x1869066291666304:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 109us (5693us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480752.734537:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 108 00000100:00100000:3.0:1782480752.739501:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2368:x1869066291666048:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 10267us (10741us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480752.739516:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 107 00000001:00080000:3.0:1782480752.978275:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1782480753.334985:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480754.359101:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480755.382979:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480755.447051:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1869066311624320:0@lo:400:kworker.0 00000100:00100000:0.0:1782480755.447069:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311624192:0@lo:400:kworker.0 00000100:00100000:3.0:1782480755.447157:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311624448:0@lo:400:kworker.0 00000100:00100000:2.0:1782480755.447239:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311624064:0@lo:400:kworker.0 00000100:00100000:0.0:1782480755.450337:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480755.450422:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311624704:0@lo:400:kworker.0 00000100:00100000:0.0:1782480755.450466:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480755.451465:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311624192 00000100:00100000:0.0:1782480755.451475:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311624192 00000100:00100000:0.0:1782480755.451528:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782480755.451553:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311624192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480755.451587:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480755.451634:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311624192:12345-0@lo:400:kworker.0 Request processed in 84us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480755.451638:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311624704 00000100:00100000:3.0:1782480755.451644:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311624704 00000100:00100000:0.0:1782480755.451644:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782480755.451696:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311624448 00000100:00100000:3.0:1782480755.451700:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311624448 00000100:00100000:0.0:1782480755.451703:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311624192:0@lo:400:kworker.0 00000100:00100000:3.0:1782480755.451739:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782480755.451764:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311624704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480755.451918:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782480755.451928:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311624448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480755.451967:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311624448:12345-0@lo:400:kworker.0 Request processed in 42us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480755.451973:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1782480755.451990:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782480755.451993:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782480755.455121:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1782480755.455259:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d75540700 x1869066311624448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480755.455272:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311624320 00000100:00100000:1.0:1782480755.455277:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311624448:0@lo:400:kworker.0 00000100:00100000:0.0:1782480755.455282:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311624320 00000100:00080000:1.0:1782480755.455310:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480755.455351:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782480755.455362:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869066311624320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480755.455504:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869066311624320:12345-0@lo:400:kworker.0 Request processed in 144us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480755.455513:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1782480755.457120:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480755.457165:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311624576:0@lo:400:kworker.0 00000100:00100000:2.0:1782480755.457202:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480755.457260:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311624576 00000100:00100000:2.0:1782480755.457266:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311624576 00000100:00100000:2.0:1782480755.457311:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1782480755.457318:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869066311624576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480755.457360:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869066311624576:12345-0@lo:400:kworker.0 Request processed in 43us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480755.457366:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1782480755.457382:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480755.457403:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311624576:0@lo:400:kworker.0 00000100:00100000:0.0:1782480755.457522:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311624064 00000100:00100000:0.0:1782480755.457527:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311624064 00000100:00100000:0.0:1782480755.457635:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1782480755.457644:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3318:x1869066311624064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480755.457681:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3318:x1869066311624064:12345-0@lo:400:kworker.0 Request processed in 38us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480755.457687:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1782480755.457902:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311624704:12345-0@lo:400:kworker.0 Request processed in 6153us (7432us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480755.457912:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782480755.457934:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1869066311624320:0@lo:400:kworker.0 00000100:00100000:0.0:1782480755.458005:0:3315:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1782480755.458011:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d75543b80, transno 4294967300 00000100:00100000:0.0:1782480755.458046:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311624704:0@lo:400:kworker.0 00000100:00100000:2.0:1782480755.458698:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311624064:0@lo:400:kworker.0 00000100:00100000:1.0:1782480755.959555:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f12b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311624832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480755.959631:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480755.959784:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311624832 00000100:00100000:3.0:1782480755.959799:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311624832 00000100:00100000:3.0:1782480755.959861:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782480755.959871:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75543b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311624832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782480755.959906:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480755.960419:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75543b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311624832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 547us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480755.960427:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1782480755.960503:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f12b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311624832:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782480756.408357:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480757.431239:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480757.497318:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782480757.497341:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311624960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480757.497423:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480757.497493:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311624960 00000100:00100000:1.0:1782480757.497503:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311624960 00000100:00100000:1.0:1782480757.497580:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782480757.497590:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311624960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782480757.497627:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480757.497680:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311624960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480757.497687:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1782480757.497766:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782480757.498943:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d460b0000 x1869066311624960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480757.498969:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311624960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480757.848196:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480757.848262:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480757.848295:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480757.848321:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480757.848513:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291666688 00000100:00100000:0.0:1782480757.848522:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291666688 00000100:00100000:0.0:1782480757.848597:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:0.0:1782480757.848607:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2366:x1869066291666688:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480757.848680:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2366:x1869066291666688:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 74us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480757.848688:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:2.0:1782480757.849056:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291666432 00000100:00100000:2.0:1782480757.849062:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291666432 00000100:00100000:2.0:1782480757.849097:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 278 00000100:00100000:2.0:1782480757.849105:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2366:x1869066291666432:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480757.849153:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2366:x1869066291666432:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 49us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480757.849160:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 278 00000100:00080000:3.0:1782480757.849434:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782480757.849772:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291666560 00000100:00100000:1.0:1782480757.849778:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291666560 00000100:00100000:1.0:1782480757.849827:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291666816 00000100:00100000:1.0:1782480757.849842:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291666816 00000100:00100000:1.0:1782480757.849876:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 112 00000100:00080000:3.0:1782480757.849877:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480757.849884:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2367:x1869066291666560:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480757.849902:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 113 00000100:00100000:3.0:1782480757.849910:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2367:x1869066291666816:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480757.849926:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2367:x1869066291666560:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 44us (1741us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480757.849933:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 112 00000100:00100000:3.0:1782480757.849935:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2367:x1869066291666816:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 27us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480757.849940:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 113 00010000:00010000:2.0:1782480758.454990:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480759.478902:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480760.506273:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480760.567108:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1869066311625344:0@lo:400:kworker.0 00000100:00100000:3.0:1782480760.567159:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311625216:0@lo:400:kworker.0 00000100:00100000:2.0:1782480760.567183:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480760.567262:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311625088:0@lo:400:kworker.0 00000100:00100000:1.0:1782480760.567322:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311625472:0@lo:400:kworker.0 00000100:00100000:3.0:1782480760.567340:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480760.567370:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480760.567401:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311625728:0@lo:400:kworker.0 00000100:00100000:1.0:1782480760.567442:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311625344 00000100:00100000:1.0:1782480760.567450:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311625344 00000100:00100000:3.0:1782480760.567467:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480760.567503:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311625216 00000100:00100000:1.0:1782480760.567507:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311625216 00000100:00100000:1.0:1782480760.567529:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1782480760.567537:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869066311625344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480760.567584:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869066311625344:12345-0@lo:400:kworker.0 Request processed in 47us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480760.567592:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1782480760.567610:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782480760.567616:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311625216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480760.567644:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311625216:12345-0@lo:400:kworker.0 Request processed in 29us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480760.567650:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1782480760.567675:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311625472 00000100:00100000:1.0:1782480760.567680:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311625472 00000100:00100000:3.0:1782480760.567704:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311625216:0@lo:400:kworker.0 00000100:00100000:1.0:1782480760.567705:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311625728 00000100:00100000:1.0:1782480760.567711:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311625728 00000100:00100000:1.0:1782480760.567733:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782480760.567766:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311625472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480760.567800:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311625472:12345-0@lo:400:kworker.0 Request processed in 54us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480760.567808:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1782480760.567819:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782480760.567823:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1782480760.567826:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782480760.567831:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480760.567832:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311625728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480760.567872:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311625728:12345-0@lo:400:kworker.0 Request processed in 40us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480760.567877:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782480760.567889:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311625728:0@lo:400:kworker.0 00010000:00080000:1.0:1782480760.567912:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d473daa00 x1869066311625472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480760.567936:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311625472:0@lo:400:kworker.0 00000100:00100000:2.0:1782480760.568091:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1869066311625344:0@lo:400:kworker.0 00000100:00100000:0.0:1782480760.570887:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480760.570966:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311625600:0@lo:400:kworker.0 00000100:00100000:0.0:1782480760.571010:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480760.571212:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311625088 00000100:00100000:2.0:1782480760.571220:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311625088 00000100:00100000:2.0:1782480760.571272:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1782480760.571281:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3318:x1869066311625088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480760.571349:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3318:x1869066311625088:12345-0@lo:400:kworker.0 Request processed in 69us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480760.571367:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1782480760.571794:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311625088:0@lo:400:kworker.0 00000100:00100000:3.0:1782480760.579142:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311625600 00000100:00100000:3.0:1782480760.579157:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311625600 00000100:00100000:3.0:1782480760.579260:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1782480760.579271:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869066311625600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480760.579371:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869066311625600:12345-0@lo:400:kworker.0 Request processed in 102us (8359us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480760.579378:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1782480760.579605:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311625600:0@lo:400:kworker.0 00000100:00080000:0.0:1782480760.579652:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480761.079317:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480761.079342:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311625856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480761.079413:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480761.080163:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311625856 00000100:00100000:1.0:1782480761.080173:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311625856 00000100:00100000:1.0:1782480761.080244:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782480761.080256:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311625856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480761.080307:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480761.080607:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311625856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 342us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480761.080616:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782480761.082562:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311625856:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1782480761.335581:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782480761.527321:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480762.553053:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480762.616223:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782480762.616248:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311625984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480762.616316:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480762.616693:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311625984 00000100:00100000:3.0:1782480762.616714:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311625984 00000100:00100000:3.0:1782480762.616806:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782480762.616817:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311625984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480762.616852:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480762.616920:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311625984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480762.616927:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1782480762.616932:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782480762.616965:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d460b3480 x1869066311625984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480762.616999:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311625984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480762.970442:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480762.970508:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480762.970594:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291666944 00000100:00100000:2.0:1782480762.970602:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291666944 00000100:00100000:2.0:1782480762.970646:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 280 00000100:00100000:2.0:1782480762.970656:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2366:x1869066291666944:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480762.970729:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2366:x1869066291666944:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 74us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480762.970884:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 280 00000100:00100000:3.0:1782480762.970961:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291667072 00000100:00100000:3.0:1782480762.970966:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291667072 00000100:00100000:3.0:1782480762.971019:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:3.0:1782480762.971028:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2366:x1869066291667072:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480762.971075:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2366:x1869066291667072:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 45us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480762.971083:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00080000:0.0:1782480762.971159:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480762.987759:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480762.987902:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480762.988010:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291667200 00000100:00100000:1.0:1782480762.988132:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291667200 00000100:00100000:1.0:1782480762.988255:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:1.0:1782480762.988279:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2365:x1869066291667200:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:1.0:1782480762.988311:0:6605:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c023bc5 00000100:00080000:1.0:1782480762.988320:0:6605:0:(import.c:65:import_set_state_nolock()) ffff9b6d74f3d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782480762.988363:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1782480762.988623:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+2:2365:x1869066291667200:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 345us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480762.988631:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00010000:00010000:1.0:1782480762.988654:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480762.989354:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291667328 00000100:00100000:3.0:1782480762.989362:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291667328 00000100:00080000:0.0:1782480762.989429:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782480762.989434:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782480763.000836:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 118 00000100:00100000:3.0:1782480763.000853:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291667328:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480763.000967:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291667328:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 119us (13232us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480763.000975:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 118 00000001:00100000:0.0:1782480763.186177:0:7497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 49099535-dcd3-436f-aa96-9770a3f52e5b 00000020:00000080:0.0:1782480763.186189:0:7497:0:(genops.c:906:class_export_put()) final put ffff9b6d74f3c000/49099535-dcd3-436f-aa96-9770a3f52e5b 00000020:00000080:1.0:1782480763.186272:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d74f3c000/49099535-dcd3-436f-aa96-9770a3f52e5b for lustre-OST0001 00000020:00000080:1.0:1782480763.186326:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6d74f3d800 for lustre-OST0001 00010000:00010000:2.0:1782480763.575075:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480764.599531:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480765.624348:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480765.687334:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782480765.687357:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311626112:0@lo:400:kworker.0 00000100:00100000:2.0:1782480765.687394:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1869066311626368:0@lo:400:kworker.0 00000100:00100000:0.0:1782480765.687545:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311626240:0@lo:400:kworker.0 00000100:00100000:3.0:1782480765.687581:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311626624:0@lo:400:kworker.0 00000100:00100000:2.0:1782480765.687692:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480765.688013:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311626368 00000100:00100000:2.0:1782480765.688020:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311626368 00000100:00100000:2.0:1782480765.688074:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1782480765.688227:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869066311626368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480765.688285:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869066311626368:12345-0@lo:400:kworker.0 Request processed in 202us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480765.688292:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1782480765.688396:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1869066311626368:0@lo:400:kworker.0 00000100:00080000:2.0:1782480765.688478:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480765.689742:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480765.690608:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311626240 00000100:00100000:0.0:1782480765.690615:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311626752:0@lo:400:kworker.0 00000100:00100000:2.0:1782480765.690616:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311626240 00000100:00100000:0.0:1782480765.690657:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480765.690709:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311626752 00000100:00100000:0.0:1782480765.690713:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311626752 00000100:00100000:2.0:1782480765.690804:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1782480765.690825:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311626240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480765.690963:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311626240:12345-0@lo:400:kworker.0 Request processed in 150us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480765.690970:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1782480765.691145:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480765.691187:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782480765.691195:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fc11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311626496:0@lo:400:kworker.0 00000100:00100000:0.0:1782480765.691225:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782480765.691235:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311626752:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782480765.691261:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782480765.691282:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480765.691311:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311626496 00000100:00100000:2.0:1782480765.691316:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311626496 00000100:00100000:2.0:1782480765.691407:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1782480765.691414:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311626496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480765.691461:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311626496:12345-0@lo:400:kworker.0 Request processed in 48us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480765.691467:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1782480765.691524:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7fc11880 x1869066311626496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480765.691537:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fc11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311626496:0@lo:400:kworker.0 00000100:00100000:0.0:1782480765.691644:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311626752:12345-0@lo:400:kworker.0 Request processed in 411us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480765.691651:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782480765.691680:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311626240:0@lo:400:kworker.0 00000100:00100000:0.0:1782480765.691689:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311626752:0@lo:400:kworker.0 00000100:00100000:0.0:1782480765.691714:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311626624 00000100:00100000:0.0:1782480765.691718:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311626624 00000100:00100000:1.0:1782480765.691770:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480765.692083:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311626112 00000100:00100000:2.0:1782480765.692087:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311626112 00000100:00100000:2.0:1782480765.692125:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1782480765.692132:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3317:x1869066311626112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480765.692423:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3317:x1869066311626112:12345-0@lo:400:kworker.0 Request processed in 290us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480765.692431:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1782480765.692606:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311626112:0@lo:400:kworker.0 00000100:00080000:3.0:1782480765.693837:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782480765.693844:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480765.693975:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1782480765.693985:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869066311626624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480765.694057:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869066311626624:12345-0@lo:400:kworker.0 Request processed in 74us (2912us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480765.694063:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1782480765.696991:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fc13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311626624:0@lo:400:kworker.0 00000100:00100000:1.0:1782480766.199587:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782480766.199610:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311626880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480766.199676:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480766.200208:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311626880 00000100:00100000:3.0:1782480766.200229:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311626880 00000100:00100000:3.0:1782480766.200290:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782480766.200299:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311626880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782480766.200335:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480766.200392:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311626880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480766.200399:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782480766.200491:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311626880:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782480766.647035:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480767.674148:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480767.739023:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311627008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480767.739677:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480767.745464:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311627008 00000100:00100000:3.0:1782480767.745479:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311627008 00000100:00100000:3.0:1782480767.745726:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782480767.745742:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311627008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480767.745822:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480767.746055:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311627008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 318us (6379us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480767.746065:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1782480767.748949:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d473d9180 x1869066311627008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480767.748993:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311627008:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782480767.749618:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480768.090171:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480768.090220:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480768.090261:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480768.090301:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291667584 00000100:00100000:3.0:1782480768.090312:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291667584 00000100:00100000:3.0:1782480768.090369:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291667712 00000100:00100000:3.0:1782480768.090372:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291667712 00000100:00100000:3.0:1782480768.090399:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:3.0:1782480768.090409:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2367:x1869066291667584:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480768.090485:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2367:x1869066291667584:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 78us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480768.090493:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:3.0:1782480768.090524:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00080000:0.0:1782480768.090629:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480768.090981:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2367:x1869066291667712:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480768.091021:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2367:x1869066291667712:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 490us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480768.091152:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291667456 00000100:00100000:2.0:1782480768.091165:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291667456 00000100:00100000:2.0:1782480768.091209:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 282 00000100:00100000:2.0:1782480768.091216:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2366:x1869066291667456:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480768.091243:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2366:x1869066291667456:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 28us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480768.091249:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 282 00000100:00100000:3.0:1782480768.094671:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 123 00010000:00010000:1.0:1782480768.695511:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480769.720927:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480770.749068:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480770.807409:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d46049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311627520:0@lo:400:kworker.0 00000100:00100000:3.0:1782480770.807483:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480770.807541:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782480770.807548:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311627136:0@lo:400:kworker.0 00000100:00100000:3.0:1782480770.807577:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480770.807599:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311627648:0@lo:400:kworker.0 00000100:00100000:3.0:1782480770.808007:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480770.808042:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311627264:0@lo:400:kworker.0 00000100:00100000:3.0:1782480770.808071:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480770.808088:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4604a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311627776:0@lo:400:kworker.0 00000100:00100000:3.0:1782480770.808112:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480770.808131:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480770.808138:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4604b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311627392:0@lo:400:kworker.0 00000100:00100000:3.0:1782480770.808159:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480770.808190:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311627520 00000100:00100000:3.0:1782480770.808197:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311627520 00000100:00100000:3.0:1782480770.808270:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311627776 00000100:00100000:3.0:1782480770.808274:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311627776 00000100:00100000:3.0:1782480770.808298:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782480770.808308:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4604ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311627520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480770.808373:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4604ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311627520:12345-0@lo:400:kworker.0 Request processed in 66us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480770.808381:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782480770.808398:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782480770.808405:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311627776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480770.808433:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311627776:12345-0@lo:400:kworker.0 Request processed in 30us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480770.808439:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782480770.808455:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311627136 00000100:00100000:3.0:1782480770.808458:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311627136 00000100:00100000:3.0:1782480770.808483:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1782480770.808489:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3317:x1869066311627136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480770.808519:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3317:x1869066311627136:12345-0@lo:400:kworker.0 Request processed in 31us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480770.808525:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1782480770.808553:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311627648 00000100:00100000:3.0:1782480770.808556:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311627648 00000100:00100000:3.0:1782480770.808580:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311627264 00000100:00100000:3.0:1782480770.808583:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311627264 00000100:00100000:3.0:1782480770.808598:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311627392 00000100:00100000:3.0:1782480770.808600:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311627392 00000100:00100000:3.0:1782480770.808615:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1782480770.808780:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311627648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480770.808811:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311627648:12345-0@lo:400:kworker.0 Request processed in 190us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480770.808817:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1782480770.808829:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1782480770.808841:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311627264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480770.808866:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311627264:12345-0@lo:400:kworker.0 Request processed in 26us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480770.808872:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1782480770.808883:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1782480770.808889:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311627392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480770.808913:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311627392:12345-0@lo:400:kworker.0 Request processed in 25us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480770.808918:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1782480770.808942:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782480770.808946:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782480770.808949:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480770.808980:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311627136:0@lo:400:kworker.0 00000100:00100000:3.0:1782480770.808993:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4604b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311627648:0@lo:400:kworker.0 00010000:00080000:3.0:1782480770.809006:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d46049f80 x1869066311627520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480770.809017:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d46049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311627520:0@lo:400:kworker.0 00000100:00100000:3.0:1782480770.809054:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4604b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311627392:0@lo:400:kworker.0 00000100:00100000:3.0:1782480770.809064:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311627264:0@lo:400:kworker.0 00000100:00100000:3.0:1782480770.809072:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4604a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311627776:0@lo:400:kworker.0 00000100:00100000:0.0:1782480771.319951:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782480771.319983:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311627904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480771.320051:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480771.320117:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311627904 00000100:00100000:0.0:1782480771.320124:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311627904 00000100:00100000:0.0:1782480771.320166:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782480771.320175:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311627904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782480771.320207:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480771.320247:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311627904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480771.320255:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782480771.320298:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311627904:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1782480771.575644:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782480771.773350:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480772.795825:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480772.857090:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4604a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311628032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480772.857357:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480772.857772:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311628032 00000100:00100000:3.0:1782480772.857780:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311628032 00000100:00100000:3.0:1782480772.857933:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782480772.858002:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311628032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480772.858045:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480772.858092:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311628032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480772.858099:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1782480772.858134:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d4604a680 x1869066311628032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480772.858153:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4604a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311628032:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782480772.858771:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480773.209559:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480773.209613:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480773.209648:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480773.209696:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291668096 00000100:00100000:0.0:1782480773.209706:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291668096 00000100:00100000:1.0:1782480773.209768:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291667840 00000100:00100000:1.0:1782480773.209776:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291667840 00000100:00100000:0.0:1782480773.209778:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291667968 00000100:00100000:0.0:1782480773.209783:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291667968 00000100:00100000:0.0:1782480773.209819:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 127 00000100:00100000:0.0:1782480773.209830:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291668096:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480773.209836:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 284 00000100:00100000:1.0:1782480773.209848:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2366:x1869066291667840:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480773.209910:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291668096:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 82us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480773.209918:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 127 00000100:00100000:0.0:1782480773.209936:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 128 00000100:00100000:0.0:1782480773.209942:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2366:x1869066291667968:12345-192.168.204.51@tcp:400:kworker.0 00000100:00080000:2.0:1782480773.211247:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480773.219374:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2366:x1869066291667840:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 9515us (9812us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480773.219375:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2366:x1869066291667968:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 9416us (9710us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480773.219401:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 284 00000100:00100000:0.0:1782480773.219474:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 128 00000001:02000400:0.0:1782480773.286477:0:11707:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 09:32:52 (1782480772) 00010000:00010000:1.0:1782480773.816218:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480774.819886:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480774.820179:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291668224 00000100:00100000:3.0:1782480774.820189:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291668224 00000100:00100000:3.0:1782480774.820251:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:3.0:1782480774.820261:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+5:10223:x1869066291668224:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480774.820281:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480774.820303:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023c90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f83f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.820380:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023c97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.820403:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023c97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.820416:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023c97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480774.820614:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782480774.820619:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480774.820789:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023c97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.820842:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023c90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f83f expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.820860:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023c97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f83f expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.820869:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddcb00) 00010000:00010000:3.0:1782480774.820872:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782480774.820875:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821eda00, rc 0) 00000100:00100000:3.0:1782480774.821360:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:10223:x1869066291668224:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1097us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480774.821369:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 32 00010000:00010000:1.0:1782480774.839923:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480774.851682:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480774.851794:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291668352 00000100:00100000:2.0:1782480774.851818:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291668352 00000100:00100000:2.0:1782480774.851895:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:2.0:1782480774.851909:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+6:10224:x1869066291668352:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782480774.852123:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480774.852150:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c023c9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f846 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.852219:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023ca5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.852233:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.852245:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.852277:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c023cac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.852285:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c023cac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.852292:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c023cac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.853187:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9000/0x3dc3ebf33c023cb3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.853202:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9000/0x3dc3ebf33c023cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.853211:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9000/0x3dc3ebf33c023cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480774.854486:0:11544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1782480774.854494:0:11544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480774.854779:0:11544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9000/0x3dc3ebf33c023cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.854798:0:11544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023ca5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.854804:0:11544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023ca5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.856116:0:11544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.856146:0:11544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8a00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480774.856152:0:11544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.856160:0:11544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023ca5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.856177:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddcb00) 00010000:00010000:2.0:1782480774.856180:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480774.856184:0:11544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023ca5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.856191:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023ca5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.856206:0:11544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c023cac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.856213:0:11544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c023cac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.856218:0:11544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c023cac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.856224:0:11544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480774.856227:0:11544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c023cac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.856232:0:11544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c023cac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.856247:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b6d45d62100) 00010000:00010000:2.0:1782480774.856249:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480774.856252:0:11544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c023cac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.856258:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c023cac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.856302:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c023c9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f846 expref: 8 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.856314:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9000/0x3dc3ebf33c023cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f846 expref: 7 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480774.856321:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b6d45d62c00) 00010000:00010000:2.0:1782480774.856323:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782480774.856326:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9000, rc 0) 00000100:00100000:2.0:1782480774.857887:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+7:10224:x1869066291668352:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 5973us (6202us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480774.857899:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:0.0:1782480774.863051:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480774.863322:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291668608 00000100:00100000:3.0:1782480774.863332:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291668608 00000100:00100000:3.0:1782480774.863405:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:3.0:1782480774.863416:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+7:10224:x1869066291668608:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480774.863437:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480774.863458:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023cba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f84d expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.863535:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023cc1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.863549:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023cc1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.863560:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023cc1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.863654:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023cc8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.863662:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.863669:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.864581:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec400/0x3dc3ebf33c023ccf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.864594:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec400/0x3dc3ebf33c023ccf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.864601:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec400/0x3dc3ebf33c023ccf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480774.864613:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1782480774.864889:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023cc1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.864897:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023cc1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.864904:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023cc1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.864910:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ed800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480774.864915:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023cc1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.864934:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023cc1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.864947:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b6d45d62c00) 00010000:00010000:3.0:1782480774.864950:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480774.864955:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023cc1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.864962:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023cc1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.864975:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.864982:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023cc8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.864987:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.864992:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ec800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480774.864994:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.865000:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023cc8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.865007:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b6d4bddce00) 00010000:00010000:3.0:1782480774.865009:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480774.865012:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023cc8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.865028:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023cc8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.865901:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023cba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f84d expref: 10 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.865922:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec400/0x3dc3ebf33c023ccf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f84d expref: 9 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480774.865929:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d4bddc700) 00010000:00010000:3.0:1782480774.865932:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480774.865936:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ec400, rc 0) 00000100:00100000:3.0:1782480774.866023:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+9:10224:x1869066291668608:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 2608us (2980us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1782480774.866032:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:2.0:1782480774.873622:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480774.873725:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291668736 00000100:00100000:3.0:1782480774.873735:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291668736 00000100:00100000:3.0:1782480774.873839:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:3.0:1782480774.873850:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+9:10224:x1869066291668736:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1782480774.873955:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+9:10224:x1869066291668736:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 Request processed in 106us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480774.873963:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00000040:00080000:0.0:1782480775.673421:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782480775.864055:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480775.931517:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311628288:0@lo:400:kworker.0 00000100:00100000:0.0:1782480775.931597:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480775.931654:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ae95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311628800:0@lo:400:kworker.0 00000100:00100000:0.0:1782480775.931695:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480775.931726:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782480775.931733:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ae95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311628416:0@lo:400:kworker.0 00000100:00100000:0.0:1782480775.931776:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480775.931810:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311628288 00000100:00100000:0.0:1782480775.931816:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311628288 00000100:00100000:0.0:1782480775.931859:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311628416 00000100:00100000:0.0:1782480775.931862:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311628416 00000100:00100000:3.0:1782480775.932028:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ae97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311628544:0@lo:400:kworker.0 00000100:00100000:3.0:1782480775.932062:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480775.932097:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782480775.932111:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311628160:0@lo:400:kworker.0 00000100:00100000:3.0:1782480775.932139:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480775.932162:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ae97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311628672:0@lo:400:kworker.0 00000100:00100000:3.0:1782480775.932183:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480775.932208:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311628800 00000100:00100000:3.0:1782480775.932212:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311628800 00000100:00100000:0.0:1782480775.932262:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311628672 00000100:00100000:0.0:1782480775.932266:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311628672 00000100:00100000:3.0:1782480775.938588:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311628544 00000100:00100000:3.0:1782480775.938604:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311628544 00000100:00100000:3.0:1782480775.938656:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782480775.938668:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311628800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480775.938789:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782480775.938800:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4604a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311628544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480775.938905:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4604a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311628544:12345-0@lo:400:kworker.0 Request processed in 108us (6842us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480775.938913:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782480775.939198:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311628800:12345-0@lo:400:kworker.0 Request processed in 532us (7501us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480775.939205:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782480775.939320:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311628160 00000100:00100000:3.0:1782480775.939326:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311628160 00000100:00100000:3.0:1782480775.939355:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1782480775.939362:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3317:x1869066311628160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480775.939399:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3317:x1869066311628160:12345-0@lo:400:kworker.0 Request processed in 37us (7259us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480775.939404:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1782480775.939439:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1782480775.939447:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311628288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480775.939480:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311628288:12345-0@lo:400:kworker.0 Request processed in 34us (7884us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480775.939487:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1782480775.939501:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1782480775.939508:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311628416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480775.939556:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311628416:12345-0@lo:400:kworker.0 Request processed in 48us (7778us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480775.939562:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1782480775.939608:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311628160:0@lo:400:kworker.0 00010000:00080000:3.0:1782480775.939637:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7ae97800 x1869066311628544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480775.939649:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ae97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311628544:0@lo:400:kworker.0 00000100:00100000:0.0:1782480775.939835:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1782480775.939850:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4604b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311628672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480775.939892:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4604b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311628672:12345-0@lo:400:kworker.0 Request processed in 44us (7708us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480775.939898:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1782480775.939927:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782480775.939931:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782480775.939934:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480775.939958:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ae97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311628672:0@lo:400:kworker.0 00000100:00100000:1.0:1782480775.940068:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ae95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311628416:0@lo:400:kworker.0 00000100:00100000:1.0:1782480775.940860:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311628288:0@lo:400:kworker.0 00000100:00100000:1.0:1782480775.940872:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ae95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311628800:0@lo:400:kworker.0 00000100:00100000:0.0:1782480776.439154:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782480776.439182:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ae97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311628928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480776.439250:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480776.439318:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311628928 00000100:00100000:0.0:1782480776.439326:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311628928 00000100:00100000:0.0:1782480776.439369:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782480776.439377:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311628928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782480776.439413:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480776.439455:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311628928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480776.439462:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782480776.439506:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ae97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311628928:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782480776.888205:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480777.120254:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480777.120325:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291668864 00000100:00100000:0.0:1782480777.120334:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291668864 00000100:00100000:0.0:1782480777.120399:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:0.0:1782480777.120423:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+9:10267:x1869066291668864:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1782480777.120443:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480777.120464:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023cdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f854 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.120537:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ce4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.120550:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.120562:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.120574:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023ceb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.120581:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023ceb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.120587:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023ceb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782480777.122777:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782480777.123887:0:11544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.123902:0:11544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ce4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.123910:0:11544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.123916:0:11544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480777.123920:0:11544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.123941:0:11544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ce4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.123958:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddcb00) 00010000:00010000:0.0:1782480777.123962:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480777.123968:0:11544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ce4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.123974:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ce4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.123990:0:11544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023ceb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.123995:0:11544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023ceb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.124000:0:11544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023ceb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.124005:0:11544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480777.124007:0:11544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023ceb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.124012:0:11544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023ceb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.124018:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b6d43255000) 00010000:00010000:0.0:1782480777.124020:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480777.124023:0:11544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023ceb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.124037:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023ceb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.124088:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023cdd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f854 expref: 10 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.124100:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddcb00) 00010000:00010000:0.0:1782480777.124102:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480777.124106:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023cdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f854 expref: 10 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.124115:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2c200, rc 0) 00000100:00100000:0.0:1782480777.124198:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+9:10267:x1869066291668864:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 3789us (3952us total) trans 0 rc 301/301 00000100:00100000:0.0:1782480777.124207:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:0.0:1782480777.130238:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480777.131010:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291669120 00000100:00100000:3.0:1782480777.131019:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291669120 00000100:00100000:3.0:1782480777.131073:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:3.0:1782480777.131084:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+9:10267:x1869066291669120:12345-192.168.204.51@tcp:36:lfs.0 00010000:00010000:3.0:1782480777.131149:0:10450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480777.131180:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023c97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f83f expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.131198:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddcb00) 00010000:00010000:3.0:1782480777.131209:0:10450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782480777.131502:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023cf2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.131518:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023cf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.131527:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023cf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.131551:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023cf9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.131558:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.131565:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480777.133101:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1782480777.133118:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023cf2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.133128:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023cf2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.133135:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023cf2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.133140:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ec800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480777.133144:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023cf2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.133152:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023cf2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.133167:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddce00) 00010000:00010000:3.0:1782480777.133170:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480777.133174:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023cf2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.133193:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023cf2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782480777.133213:0:10450:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d61eb1a1 reply state 00000000d2235318 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480777.133222:0:10450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782480777.133439:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+10:10267:x1869066291669120:12345-192.168.204.51@tcp:36:lfs.0 Request processed in 2354us (3207us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1782480777.133448:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 37 00010000:00010000:2.0:1782480777.151828:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023cf9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.151846:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023cf9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.151854:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023cf9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.151867:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ecc00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480777.151873:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023cf9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.151880:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023cf9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.151896:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b6d4bddc600) 00010000:00010000:2.0:1782480777.151899:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480777.151903:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023cf9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.151909:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023cf9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480777.242529:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480777.242614:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291669248 00000100:00100000:3.0:1782480777.242625:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291669248 00000100:00100000:3.0:1782480777.242688:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:3.0:1782480777.242697:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+9:10275:x1869066291669248:12345-192.168.204.51@tcp:101:lctl.0 00010000:00010000:3.0:1782480777.242726:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480777.242789:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023d00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f85b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.242863:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023d07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.242882:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023d07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.242896:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023d07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480777.242954:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782480777.242958:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480777.243021:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023d07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.243046:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023d00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f85b expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.243066:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023d07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f85b expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.243074:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddce00) 00010000:00010000:3.0:1782480777.243078:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782480777.243081:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821eda00, rc 0) 00000100:00100000:3.0:1782480777.243143:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+10:10275:x1869066291669248:12345-192.168.204.51@tcp:101:lctl.0 Request processed in 447us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480777.243150:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:3.0:1782480777.310078:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480777.310154:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291669376 00000100:00100000:0.0:1782480777.310165:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291669376 00000100:00100000:0.0:1782480777.310230:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:0.0:1782480777.310239:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4604b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+10:10281:x1869066291669376:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1782480777.310259:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480777.310278:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023d0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f862 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.310345:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023d15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.310373:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023d15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.310387:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023d15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.310403:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023d1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.310411:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023d1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.310721:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023d1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.310877:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d800/0x3dc3ebf33c023d23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.310887:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d800/0x3dc3ebf33c023d23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.311128:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d800/0x3dc3ebf33c023d23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480777.311167:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1782480777.311170:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480777.311212:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d800/0x3dc3ebf33c023d23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.311224:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023d15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.311240:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023d15 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.311246:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023d15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.311252:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480777.311256:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023d15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.311265:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023d15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.311277:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddce00) 00010000:00010000:0.0:1782480777.311281:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480777.311285:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023d15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.311290:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023d15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.311306:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023d1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.311311:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023d1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.311316:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023d1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.311320:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2cc00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480777.311327:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023d1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.311334:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023d1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.311340:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b6d43255000) 00010000:00010000:0.0:1782480777.311343:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480777.311346:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023d1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.311351:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023d1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.311383:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023d0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f862 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.311395:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d800/0x3dc3ebf33c023d23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f862 expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.311401:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:0.0:1782480777.311403:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782480777.311405:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2d800, rc 0) 00000100:00100000:0.0:1782480777.311504:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4604b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+11:10281:x1869066291669376:12345-192.168.204.51@tcp:101:bash.0 Request processed in 1265us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480777.311512:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:3.0:1782480777.322973:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480777.323068:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291669632 00000100:00100000:0.0:1782480777.323079:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291669632 00000100:00100000:0.0:1782480777.323160:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:0.0:1782480777.323173:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+11:10281:x1869066291669632:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1782480777.323216:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480777.323243:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023d2a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f869 expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.323427:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023d31 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.323442:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023d31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.323454:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023d31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.323506:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023d38 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.323514:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023d38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.323522:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023d38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782480777.324431:0:10450:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1782480777.324679:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c023d3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.324691:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c023d3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.324699:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c023d3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.324777:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023d31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.324786:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023d31 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.324792:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023d31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.324798:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2cc00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480777.324802:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023d31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.324809:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023d31 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.324822:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:1.0:1782480777.324825:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480777.324830:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023d31 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.324836:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023d31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782480777.324849:0:10450:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b95c9599 reply state 000000003aa4a3e8 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023d38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480777.324858:0:10450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782480777.325005:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023d2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f869 expref: 14 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.325036:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c023d3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f869 expref: 13 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.325044:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:1.0:1782480777.325046:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782480777.325049:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573000, rc 0) 00000100:00100000:1.0:1782480777.325140:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+14:10281:x1869066291669632:12345-192.168.204.51@tcp:101:bash.0 Request processed in 1970us (2178us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1782480777.325150:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00010000:00010000:3.0:1782480777.327739:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023d38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.327933:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023d38 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.327940:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023d38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.327946:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480777.327951:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023d38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.327974:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023d38 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.328001:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d43255000) 00010000:00010000:3.0:1782480777.328004:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480777.328010:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023d38 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.328016:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023d38 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480777.331278:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480777.332325:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291669760 00000100:00100000:1.0:1782480777.332338:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291669760 00000100:00100000:1.0:1782480777.332485:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:1.0:1782480777.332494:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2365:x1869066291669760:12345-192.168.204.51@tcp:8:bash.0 00010000:00080000:1.0:1782480777.332523:0:6604:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp t0 exp 0000000000000000 cur 398 last 0 00000020:00000080:1.0:1782480777.332561:0:6604:0:(genops.c:1406:class_connect()) connect: client 49099535-dcd3-436f-aa96-9770a3f52e5b, cookie 0x3dc3ebf33c023d4d 00002000:00100000:1.0:1782480777.332575:0:6604:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 49099535-dcd3-436f-aa96-9770a3f52e5b/ffff9b6d7b147000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211365f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782480777.332708:0:6604:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782480777.332963:0:6604:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782480777.333163:0:6604:0:(import.c:65:import_set_state_nolock()) ffff9b6d7b146000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782480777.333242:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2365:x1869066291669760:12345-192.168.204.51@tcp:8:bash.0 Request processed in 747us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480777.333250:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:2.0:1782480777.335627:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480777.336181:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291669888 00000100:00100000:3.0:1782480777.336191:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291669888 00000100:00100000:3.0:1782480777.336262:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:3.0:1782480777.336272:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+6:0:x1869066291669888:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1782480777.336291:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480777.336316:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ee73737/0x3dc3ebf33c023d54 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f870 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782480777.336390:0:8678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782480777.336411:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=398s v=(0 0) 00010000:00010000:3.0:1782480777.336415:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480777.336425:0:8678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ee73737/0x3dc3ebf33c023d54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f870 expref: 7 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.336445:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006ee73737/0x3dc3ebf33c023d54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f870 expref: 7 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.336479:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ec800, rc 0) 00000100:00100000:3.0:1782480777.336529:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+7:0:x1869066291669888:12345-192.168.204.51@tcp:101:bash.0 Request processed in 260us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480777.336537:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00080000:0.0:1782480777.336775:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480777.341242:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480777.341404:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291670016 00000100:00100000:3.0:1782480777.341416:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291670016 00000100:00100000:3.0:1782480777.341476:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:3.0:1782480777.341487:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+7:10281:x1869066291670016:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1782480777.341506:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480777.341524:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054205aa2/0x3dc3ebf33c023d5b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f877 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.341680:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006ee73737/0x3dc3ebf33c023d54 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f870 expref: 8 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.341691:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480777.341695:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480777.341701:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054205aa2/0x3dc3ebf33c023d5b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f877 expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.341738:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006ee73737/0x3dc3ebf33c023d54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f870 expref: 8 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.341792:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006ee73737/0x3dc3ebf33c023d54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f870 expref: 8 pid: 8678 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480777.341822:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4604bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6605:1869066311629056:192.168.204.51@tcp:104: 00000100:00100000:3.0:1782480777.342021:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d487f6600 going to sleep for 11 seconds 00000100:00100000:0.0:1782480777.368731:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480777.368885:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4604bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6605:1869066311629056:192.168.204.51@tcp:104: 00010000:00010000:3.0:1782480777.368921:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054205aa2/0x3dc3ebf33c023d5b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f877 expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480777.368941:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291670144 00010000:00010000:3.0:1782480777.368945:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ed800, rc 0) 00000100:00100000:2.0:1782480777.368950:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291670144 00010000:00010000:2.0:1782480777.368989:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006ee73737/0x3dc3ebf33c023d54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f870 expref: 9 pid: 8678 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480777.369019:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+9:10281:x1869066291670016:12345-192.168.204.51@tcp:101:bash.0 Request processed in 27532us (27784us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480777.369026:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:3.0:1782480777.369034:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:2.0:1782480777.369039:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+9:2366:x1869066291670144:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480777.369052:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480777.369074:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006ee73737/0x3dc3ebf33c023d54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f870 expref: 8 pid: 8678 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.369106:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006ee73737/0x3dc3ebf33c023d54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f870 expref: 8 pid: 8678 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.369131:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ee73737/0x3dc3ebf33c023d54 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f870 expref: 8 pid: 8678 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.369146:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480777.369150:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480777.369158:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054205aa2/0x3dc3ebf33c023d5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f877 expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.369180:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054205aa2/0x3dc3ebf33c023d5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f877 expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.369215:0:5792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000054205aa2/0x3dc3ebf33c023d5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f877 expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480777.369228:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fc10700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5792:1869066311629184:192.168.204.51@tcp:105: 00000100:00100000:2.0:1782480777.369294:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6c42ca7240 going to sleep for 11 seconds 00000100:00100000:0.0:1782480777.371317:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fc10700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5792:1869066311629184:192.168.204.51@tcp:105: 00010000:00010000:0.0:1782480777.371341:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480777.371395:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2366:x1869066291670144:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 2359us (2673us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480777.371406:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:0.0:1782480777.376698:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480777.376885:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291670400 00000100:00100000:2.0:1782480777.376894:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291670400 00000100:00100000:2.0:1782480777.376951:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:2.0:1782480777.376961:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+13:10281:x1869066291670400:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:2.0:1782480777.377315:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+14:10281:x1869066291670400:12345-192.168.204.51@tcp:35:bash.0 Request processed in 355us (625us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1782480777.377337:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:2.0:1782480777.472733:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480777.473029:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291670656 00000100:00100000:3.0:1782480777.473039:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291670656 00000100:00100000:3.0:1782480777.473093:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:3.0:1782480777.473102:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+14:10291:x1869066291670656:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1782480777.473130:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480777.473149:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023d62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f87e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480777.473260:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1782480777.473360:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023d62 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f87e expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.473374:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddce00) 00010000:00010000:3.0:1782480777.473377:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782480777.473396:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023d62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f87e expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.473412:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ec000, rc 0) 00000100:00100000:3.0:1782480777.473476:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+15:10291:x1869066291670656:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 375us (753us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1782480777.473484:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:3.0:1782480777.477023:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480777.477247:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291670912 00000100:00100000:2.0:1782480777.477258:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291670912 00000100:00100000:2.0:1782480777.477324:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:2.0:1782480777.477334:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4604bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+15:10291:x1869066291670912:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1782480777.477647:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4604bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+16:10291:x1869066291670912:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 313us (635us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1782480777.477656:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:0.0:1782480777.560045:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480777.560159:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291671040 00000100:00100000:2.0:1782480777.560169:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291671040 00000100:00100000:2.0:1782480777.560230:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:2.0:1782480777.560241:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+16:10297:x1869066291671040:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1782480777.560265:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480777.560285:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c023d70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f885 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.560355:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c023d77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.560380:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c023d77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.560392:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c023d77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480777.560455:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1782480777.560474:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480777.560502:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c023d77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.560528:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c023d70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f885 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.560547:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c023d77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f885 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.560567:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:2.0:1782480777.560570:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782480777.560573:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e8200, rc 0) 00000100:00100000:2.0:1782480777.560642:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+17:10297:x1869066291671040:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 403us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480777.561040:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:3.0:1782480777.567676:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480777.567875:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291671296 00000100:00100000:1.0:1782480777.567887:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291671296 00000100:00100000:1.0:1782480777.567958:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:1.0:1782480777.567967:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4604a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+17:10297:x1869066291671296:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1782480777.567996:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480777.568018:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c023d7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f88c expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.568115:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c023d85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.568128:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c023d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.568139:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c023d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480777.568149:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1782480777.568282:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c023d7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f88c expref: 20 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.568300:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c023d85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f88c expref: 19 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.568308:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:1.0:1782480777.568310:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782480777.568313:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573200, rc 0) 00000100:00100000:1.0:1782480777.568376:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4604a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+19:10297:x1869066291671296:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 410us (710us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1782480777.568383:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:3.0:1782480777.579122:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480777.579222:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291671424 00000100:00100000:0.0:1782480777.579232:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291671424 00000100:00100000:0.0:1782480777.579301:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:0.0:1782480777.579312:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46048a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+19:2368:x1869066291671424:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480777.579329:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480777.579357:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c023d85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f88c expref: 19 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.579376:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:0.0:1782480777.579380:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480777.579445:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46048a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+18:2368:x1869066291671424:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 135us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480777.579453:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:0.0:1782480777.582488:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480777.583417:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291671680 00000100:00100000:2.0:1782480777.583428:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291671680 00000100:00100000:2.0:1782480777.583503:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:2.0:1782480777.583513:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+18:10297:x1869066291671680:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1782480777.583538:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480777.583556:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023d93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f893 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.583738:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023d9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.583781:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023d9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.583812:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023d9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480777.583826:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1782480777.585094:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023d93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f893 expref: 21 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.585116:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023d9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f893 expref: 20 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.585123:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:2.0:1782480777.585126:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782480777.585130:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9600, rc 0) 00000100:00100000:2.0:1782480777.585209:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+20:10297:x1869066291671680:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1696us (2730us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1782480777.585217:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:2.0:1782480777.602950:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480777.603090:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291671808 00000100:00100000:3.0:1782480777.603110:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291671808 00000100:00100000:3.0:1782480777.603171:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:3.0:1782480777.603181:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2366:x1869066291671808:12345-192.168.204.51@tcp:1:lfs.0 00010000:00010000:3.0:1782480777.603225:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e819c2b/0x3dc3ebf33c023da8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.603247:0:8678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054205aa2/0x3dc3ebf33c023d5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f877 expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.603257:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480777.603261:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782480777.603265:0:8678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e819c2b/0x3dc3ebf33c023da8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.603303:0:8678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000054205aa2/0x3dc3ebf33c023d5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f877 expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.603336:0:8678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000054205aa2/0x3dc3ebf33c023d5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f877 expref: 7 pid: 6605 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480777.603351:0:8678:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4604aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8678:1869066311629312:192.168.204.51@tcp:104: 00000100:00100000:3.0:1782480777.603513:0:8678:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d487f6600 going to sleep for 11 seconds 00000100:00100000:0.0:1782480777.612679:0:8678:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4604aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8678:1869066311629312:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480777.612714:0:8678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000e819c2b/0x3dc3ebf33c023da8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480777.615515:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480777.615638:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291671936 00000100:00100000:3.0:1782480777.615655:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291671936 00002000:00100000:3.0:1782480777.615715:0:6608:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9b6d7fc13100 x1869066291671936/t0(0) o4->49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp:533/0 lens 504/0 e 0 to 0 dl 1782480788 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782480777.615726:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d7fc13100 with x1869066291671936 ext(0->12) 00010000:00010000:3.0:1782480777.615736:0:6608:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000054205aa2/0x3dc3ebf33c023d5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f877 expref: 8 pid: 6605 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.615776:0:6608:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000054205aa2/0x3dc3ebf33c023d5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f877 expref: 8 pid: 6605 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782480777.615785:0:6608:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b6d7fc13100 00000100:00100000:3.0:1782480777.615821:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:3.0:1782480777.615831:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2366:x1869066291671936:12345-192.168.204.51@tcp:4:lfs.0 00000001:00100000:0.0:1782480777.704216:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 49099535-dcd3-436f-aa96-9770a3f52e5b 00000100:00100000:1.0:1782480777.706106:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+9:2366:x1869066291671936:12345-192.168.204.51@tcp:4:lfs.0 Request processed in 90267us (90592us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1782480777.706141:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00002000:00100000:1.0:1782480777.706155:0:6608:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9b6d7fc13100 x1869066291671936/t4294967299(0) o4->49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp:533/0 lens 504/448 e 0 to 0 dl 1782480788 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782480777.706167:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d7fc13100 with x1869066291671936 ext(0->12) 00010000:00010000:1.0:1782480777.706178:0:6608:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000054205aa2/0x3dc3ebf33c023d5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f877 expref: 9 pid: 6605 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.706198:0:6608:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000054205aa2/0x3dc3ebf33c023d5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f877 expref: 9 pid: 6605 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782480777.706207:0:6608:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b6d7fc13100 00000100:00100000:3.0:1782480777.708841:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480777.710616:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291672064 00000100:00100000:1.0:1782480777.710629:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291672064 00010000:00010000:1.0:1782480777.710679:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000054205aa2/0x3dc3ebf33c023d5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f877 expref: 9 pid: 6605 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480777.710732:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:1.0:1782480777.710743:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46048380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+9:2369:x1869066291672064:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480777.710805:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1782480777.710825:0:5793:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1782480777.710828:0:5793:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1782480777 00002000:00010000:1.0:1782480777.710830:0:5793:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1782480778 00002000:00010000:1.0:1782480777.710832:0:5793:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1782480777 00010000:00010000:1.0:1782480777.710838:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000054205aa2/0x3dc3ebf33c023d5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f877 expref: 9 pid: 6605 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.710875:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000054205aa2/0x3dc3ebf33c023d5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f877 expref: 9 pid: 6605 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.710903:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054205aa2/0x3dc3ebf33c023d5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f877 expref: 9 pid: 6605 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.710923:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782480777.710928:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782480777.710934:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e819c2b/0x3dc3ebf33c023da8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.710944:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e819c2b/0x3dc3ebf33c023da8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.711039:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480777.711066:0:8678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000e819c2b/0x3dc3ebf33c023da8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.711079:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e819c2b/0x3dc3ebf33c023da8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480777.711111:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46048380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2369:x1869066291672064:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 368us (2276us total) trans 0 rc 0/0 00010000:00010000:0.0:1782480777.711119:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e819c2b/0x3dc3ebf33c023da8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480777.711121:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00010000:00010000:0.0:1782480777.711132:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e819c2b/0x3dc3ebf33c023da8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.711142:0:8678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e819c2b/0x3dc3ebf33c023da8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.711149:0:8678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821edc00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:0.0:1782480777.711155:0:8678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e819c2b/0x3dc3ebf33c023da8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.711163:0:8678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e819c2b/0x3dc3ebf33c023da8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.711177:0:8678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e819c2b/0x3dc3ebf33c023da8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.711185:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e819c2b/0x3dc3ebf33c023da8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480777.711237:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2366:x1869066291671808:12345-192.168.204.51@tcp:1:lfs.0 Request processed in 108057us (108301us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480777.711245:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:3.0:1782480777.714293:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480777.714777:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291672320 00000100:00100000:2.0:1782480777.714786:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291672320 00000100:00100000:2.0:1782480777.714838:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:2.0:1782480777.714858:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+20:10297:x1869066291672320:12345-192.168.204.51@tcp:35:lfs.0 00000004:00010000:2.0:1782480777.714932:0:5810:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023d9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f893 expref: 20 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782480777.715231:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1782480777.715300:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1782480777.715987:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1782480777.716045:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023daf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.716061:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c023d3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f869 expref: 24 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.716071:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023daf lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.716106:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c023d3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f869 expref: 24 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.716119:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c023d3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f869 expref: 24 pid: 10450 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480777.716134:0:5810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fc11f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5810:1869066311629440:192.168.204.51@tcp:104: 00000100:00100000:2.0:1782480777.716234:0:5810:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6c42ca7780 going to sleep for 11 seconds 00000100:00100000:3.0:1782480777.719366:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480777.719493:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291672448 00000100:00100000:0.0:1782480777.719502:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291672448 00010000:00010000:0.0:1782480777.719544:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c023d3f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f869 expref: 25 pid: 10450 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480777.719584:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:0.0:1782480777.719597:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46049180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+25:2367:x1869066291672448:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480777.719613:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480777.719621:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c023d3f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f869 expref: 25 pid: 10450 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.719633:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c023d3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f869 expref: 25 pid: 10450 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.719657:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:0.0:1782480777.719663:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023daf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.719673:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023daf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.719680:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023daf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.719700:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480777.719781:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46049180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+25:2367:x1869066291672448:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 186us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480777.719789:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 37 00010000:00010000:2.0:1782480777.720361:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c023d3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f869 expref: 24 pid: 10450 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480777.720383:0:5810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fc11f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5810:1869066311629440:192.168.204.51@tcp:104: 00010000:00010000:2.0:1782480777.720413:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023daf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.720424:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023daf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.720431:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023daf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782480777.720572:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1782480777.730117:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1782480777.730296:0:5810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4604b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1869066311629568:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1782480777.730380:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480777.730468:0:5810:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75c05d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782480777.740306:0:5812:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311629568 00000100:00100000:3.0:1782480777.740321:0:5812:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311629568 00000100:00100000:3.0:1782480777.740418:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1782480777.740418:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480777.740430:0:5812:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4604aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5810:x1869066311629568:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1782480777.740588:0:5812:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4604aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5810:x1869066311629568:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 150us (10197us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480777.740597:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782480777.740647:0:5810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4604b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1869066311629568:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1782480777.741983:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1782480777.742072:0:5810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ae94a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1869066311629696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782480777.742128:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480777.742166:0:5810:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45f4d240 going to sleep for 11 seconds 00000100:00100000:3.0:1782480777.742180:0:5812:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311629696 00000100:00100000:3.0:1782480777.742188:0:5812:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311629696 00000100:00100000:3.0:1782480777.742236:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782480777.742245:0:5812:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5810:x1869066311629696:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1782480777.742437:0:5812:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5810:x1869066311629696:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 191us (307us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1782480777.742446:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782480777.742689:0:5810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ae94a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1869066311629696:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1782480777.742742:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1782480777.742882:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023daf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.742893:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023daf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.742900:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023daf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.742907:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8a00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480777.742913:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023daf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.742921:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023daf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.742939:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:0.0:1782480777.742942:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1782480777.742948:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023daf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.742953:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023daf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782480777.743685:0:5810:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1782480777.744197:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1782480777.746419:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 398585463141ns, next at 399585460588ns, rc = 0 00000001:00080000:0.0:1782480777.746448:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1782480777.747045:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:0.0:1782480777.747051:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782480777.747063:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023d9a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f893 expref: 28 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480777.747348:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+27:10297:x1869066291672320:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 32490us (33065us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1782480777.747360:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000020:00080000:0.0:1782480777.747367:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1782480777.759634:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480777.759808:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291672576 00000100:00100000:0.0:1782480777.759818:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291672576 00000100:00100000:0.0:1782480777.759883:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:0.0:1782480777.759893:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4604b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+27:10297:x1869066291672576:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1782480777.759922:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480777.759948:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c023db6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f89a expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.760015:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c023db6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f89a expref: 28 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.760033:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c023db6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f89a expref: 28 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480777.760075:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:0.0:1782480777.760079:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782480777.760082:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2da00, rc 0) 00000100:00100000:0.0:1782480777.760156:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4604b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+28:10297:x1869066291672576:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 264us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480777.760163:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:3.0:1782480777.766241:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480777.766402:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291672832 00000100:00100000:0.0:1782480777.766412:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291672832 00000100:00100000:0.0:1782480777.766486:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:0.0:1782480777.766498:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+28:10297:x1869066291672832:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1782480777.766982:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+29:10297:x1869066291672832:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 484us (749us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1782480777.766991:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:2.0:1782480777.885397:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480777.893367:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291673088 00000100:00100000:3.0:1782480777.893381:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291673088 00000100:00100000:3.0:1782480777.893458:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:3.0:1782480777.893470:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+29:10307:x1869066291673088:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1782480777.893507:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480777.893527:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023dbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f8a1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480777.893657:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1782480777.893814:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023dbd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8a1 expref: 31 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.893828:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddce00) 00010000:00010000:3.0:1782480777.893831:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782480777.893844:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023dbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8a1 expref: 31 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480777.893859:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ec000, rc 0) 00000100:00100000:3.0:1782480777.893934:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+30:10307:x1869066291673088:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 466us (8544us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1782480777.893942:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:3.0:1782480777.899029:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480777.899439:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291673216 00000100:00100000:2.0:1782480777.899449:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291673216 00000100:00100000:2.0:1782480777.899520:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:2.0:1782480777.899530:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4604bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+30:10307:x1869066291673216:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:2.0:1782480777.899636:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c023dcb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.899653:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c023dcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.899665:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c023dcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.899681:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c023dd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.899688:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c023dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.899695:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c023dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.899847:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023dd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.899856:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.899864:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480777.899923:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.899936:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c023dcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.899943:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c023dcb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.899949:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c023dcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.899956:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480777.899960:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c023dcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.899967:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c023dcb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.899979:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:2.0:1782480777.899982:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480777.899987:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c023dcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.899993:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c023dcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.900007:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c023dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.900014:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c023dd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.900027:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c023dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.900032:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480777.900035:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c023dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.900041:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c023dd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.900048:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d45d62100) 00010000:00010000:2.0:1782480777.900050:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480777.900053:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c023dd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.900058:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c023dd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.900071:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.900077:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023dd9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.900082:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.900086:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480777.900089:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.900104:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023dd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.900112:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:2.0:1782480777.900115:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480777.900118:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023dd9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480777.900123:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023dd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480777.901500:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4604bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+30:10307:x1869066291673216:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 1960us (2470us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480777.901512:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:3.0:1782480777.913123:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00010000:00010000:3.0:1782480777.913207:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480777.913223:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291673472 00000100:00100000:3.0:1782480777.913235:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291673472 00000100:00100000:3.0:1782480777.913290:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:3.0:1782480777.913302:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+30:10307:x1869066291673472:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1782480777.913586:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+31:10307:x1869066291673472:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 274us (460us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1782480777.913595:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:0.0:1782480777.977441:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311629824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480777.977523:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480777.978825:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311629824 00000100:00100000:3.0:1782480777.978839:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311629824 00000100:00100000:3.0:1782480777.978891:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1782480777.978899:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1869066311629824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480777.978922:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480777.979033:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1869066311629824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480777.979040:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782480777.979177:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311629824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480777.992365:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480777.992632:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291673728 00000100:00100000:1.0:1782480777.992643:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291673728 00000100:00100000:1.0:1782480777.992711:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:1.0:1782480777.992723:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+31:10310:x1869066291673728:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1782480777.992786:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480777.992821:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c023de0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f8a8 expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.992919:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c023de7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993148:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c023de7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993163:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c023de7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993181:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c023dee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993188:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c023dee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993194:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c023dee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993395:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c023df5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993404:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c023df5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993411:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c023df5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480777.993422:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1782480777.993521:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c023de7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993541:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c023de7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993548:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c023de7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993555:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572600 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480777.993559:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c023de7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993568:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c023de7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993591:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:1.0:1782480777.993594:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480777.993600:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c023de7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993606:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c023de7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993619:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c023dee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993626:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c023dee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993631:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c023dee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993637:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480777.993647:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c023dee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993654:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c023dee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993662:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d5230f800) 00010000:00010000:1.0:1782480777.993665:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480777.993667:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c023dee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993673:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c023dee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.993716:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c023de0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8a8 expref: 34 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.994399:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c023df5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8a8 expref: 33 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480777.994411:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:1.0:1782480777.994413:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782480777.994416:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572400, rc 0) 00000100:00100000:1.0:1782480777.994498:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+33:10310:x1869066291673728:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1776us (2153us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1782480777.994507:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:2.0:1782480778.002655:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480778.003143:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291673856 00000100:00100000:0.0:1782480778.003153:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291673856 00000100:00100000:0.0:1782480778.003223:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:0.0:1782480778.003234:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+33:10310:x1869066291673856:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:0.0:1782480778.003306:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023e03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.003323:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023e03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.003335:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023e03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.003385:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023e03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.003391:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023e03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.003398:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023e03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.003405:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480778.003409:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023e03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.003416:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023e03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.003430:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:0.0:1782480778.003434:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782480778.003439:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023e03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.003445:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023e03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480778.003542:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+33:10310:x1869066291673856:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 308us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480778.003550:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:2.0:1782480778.008591:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480778.008881:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291674112 00000100:00100000:3.0:1782480778.008892:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291674112 00000100:00100000:3.0:1782480778.008961:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1782480778.008971:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+33:10310:x1869066291674112:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1782480778.009230:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+34:10310:x1869066291674112:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 259us (659us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1782480778.009239:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1782480778.336673:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480778.336734:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480778.336816:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291674368 00000100:00100000:2.0:1782480778.336828:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291674368 00000100:00100000:2.0:1782480778.336913:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 132 00000100:00100000:2.0:1782480778.336926:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2367:x1869066291674368:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480778.337004:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2367:x1869066291674368:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 83us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480778.337010:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 132 00000100:00080000:0.0:1782480778.337183:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480778.337425:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291674240 00000100:00100000:1.0:1782480778.337431:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291674240 00000100:00100000:1.0:1782480778.337471:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 286 00000100:00100000:1.0:1782480778.337479:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2367:x1869066291674240:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480778.337540:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2367:x1869066291674240:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 61us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480778.337547:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 286 00000100:00100000:3.0:1782480778.374385:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480778.374581:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291674624 00000100:00100000:1.0:1782480778.374591:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291674624 00000100:00100000:1.0:1782480778.374658:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:1.0:1782480778.374669:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+34:10341:x1869066291674624:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:1.0:1782480778.374692:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480778.374732:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c023e0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f8af expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.375062:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c023e11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.375079:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c023e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.375092:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c023e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480778.375104:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1782480778.375253:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c023e0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8af expref: 37 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.375272:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c023e11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8af expref: 36 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.375280:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:1.0:1782480778.375297:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782480778.375301:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572200, rc 0) 00000100:00100000:1.0:1782480778.375441:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+36:10341:x1869066291674624:12345-192.168.204.51@tcp:101:cat.0 Request processed in 772us (1064us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1782480778.375448:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:2.0:1782480778.379014:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480778.379113:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291674752 00000100:00100000:0.0:1782480778.379123:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291674752 00000100:00100000:0.0:1782480778.379206:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:0.0:1782480778.379216:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d465fc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+36:2366:x1869066291674752:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480778.379234:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480778.379258:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c023e11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8af expref: 36 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.379277:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:0.0:1782480778.379282:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480778.379345:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d465fc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+35:2366:x1869066291674752:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 130us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480778.379353:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:3.0:1782480778.379651:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480778.380262:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291675008 00000100:00100000:0.0:1782480778.380269:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291675008 00000100:00100000:0.0:1782480778.380310:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:0.0:1782480778.380319:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+35:10341:x1869066291675008:12345-192.168.204.51@tcp:35:cat.0 00000100:00100000:0.0:1782480778.384470:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+36:10341:x1869066291675008:12345-192.168.204.51@tcp:35:cat.0 Request processed in 4137us (4803us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1782480778.384486:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:2.0:1782480778.467686:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480778.468243:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291675264 00000100:00100000:0.0:1782480778.468253:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291675264 00000100:00100000:0.0:1782480778.468422:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:0.0:1782480778.468434:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+36:10347:x1869066291675264:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:0.0:1782480778.468461:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480778.468465:0:11544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782480778.468494:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c023d77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f885 expref: 36 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.468533:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:0.0:1782480778.468538:0:11544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480778.468552:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023e1f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f8b6 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.468663:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.468678:0:11544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c023df5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8a8 expref: 36 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.468687:0:11544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e26 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.469105:0:11544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c023df5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8a8 expref: 36 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.469119:0:11544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c023df5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8a8 expref: 36 pid: 10450 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480778.469134:0:11544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ae94000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11544:1869066311629952:192.168.204.51@tcp:104: 00000100:00100000:0.0:1782480778.469229:0:11544:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45f4d600 going to sleep for 11 seconds 00000100:00100000:2.0:1782480778.471729:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480778.471871:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291675392 00000100:00100000:1.0:1782480778.471881:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291675392 00010000:00010000:1.0:1782480778.471923:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c023df5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8a8 expref: 37 pid: 10450 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480778.471967:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:1.0:1782480778.471977:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+37:2366:x1869066291675392:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480778.472007:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480778.472014:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c023df5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8a8 expref: 37 pid: 10450 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.472027:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c023df5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8a8 expref: 37 pid: 10450 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.472050:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:1.0:1782480778.472055:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.472065:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.472074:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e26 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.472113:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480778.472171:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+37:2366:x1869066291675392:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 194us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480778.472180:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 38 00010000:00010000:0.0:1782480778.472524:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c023df5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8a8 expref: 36 pid: 10450 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480778.472541:0:11544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ae94000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11544:1869066311629952:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480778.472586:0:11544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.472596:0:11544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.472601:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480778.472619:0:11544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1782480778.472813:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023e1f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8b6 expref: 37 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.472841:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8b6 expref: 36 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.472849:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:0.0:1782480778.472852:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782480778.472854:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2dc00, rc 0) 00000100:00100000:0.0:1782480778.472882:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+36:10347:x1869066291675264:12345-192.168.204.51@tcp:101:dd.0 Request processed in 4451us (5206us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1782480778.472890:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:3.0:1782480778.476580:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480778.477282:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291675648 00000100:00100000:0.0:1782480778.477292:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291675648 00000100:00100000:0.0:1782480778.477428:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:0.0:1782480778.477439:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+36:10347:x1869066291675648:12345-192.168.204.51@tcp:36:dd.0 00010000:00010000:0.0:1782480778.477735:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023e34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.477804:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023e34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.477815:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023e34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782480778.478501:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1782480778.478539:0:5807:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c983088b reply state 0000000044b38f51 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023e34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480778.478550:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782480778.478670:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+39:10347:x1869066291675648:12345-192.168.204.51@tcp:36:dd.0 Request processed in 1230us (2105us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1782480778.478677:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00000020:00080000:0.0:1782480778.478682:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782480778.484876:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023e34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.484892:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023e34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.484924:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023e34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.484931:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480778.484936:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023e34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.484944:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023e34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.484961:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:1.0:1782480778.484964:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480778.484969:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023e34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.484974:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c023e34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782480778.583928:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000004:00080000:3.0:1782480778.583962:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1782480778.583987:0:5829:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b6d45f4d540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1782480778.583992:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9b6d46018c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d45f4dd80 00000020:00080000:3.0:1782480778.583995:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9b6d46018300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d751ce000 00000020:00080000:3.0:1782480778.584060:0:5841:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1782480778.584190:0:5841:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1782480778.584597:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782480778.584620:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311630080:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782480778.584706:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480778.584978:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311630080 00000100:00100000:2.0:1782480778.585004:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311630080 00000100:00100000:2.0:1782480778.585062:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782480778.585071:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1869066311630080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782480778.585101:0:6604:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1782480778.585132:0:6604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a3e7f89, atime: 0x6a3e7f8a, ctime: 0x6a3e7f89, blocks: 0x1 00010000:00010000:2.0:1782480778.585141:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c023e3b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480778.585158:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=399s v=(0 0) 00010000:00010000:2.0:1782480778.585162:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480778.585168:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c023e3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480778.585183:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c023e3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480778.585193:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c023e3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480778.585201:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c023e3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480778.585226:0:6604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782480778.585740:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3317:x1869066311630080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 669us (1032us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782480778.585776:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:2.0:1782480778.586059:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d7fc10e00/2, rc 0, transno 4294967301 00000100:00100000:2.0:1782480778.586074:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311630080:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782480778.586232:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480778.586243:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c023e3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.586254:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8800 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480778.586258:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c023e3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.586269:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c023e3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.586289:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c023e3b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.586297:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c023e3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.586318:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480778.586320:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480778.586322:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480778.815643:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480778.815783:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291675776 00000100:00100000:1.0:1782480778.815792:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291675776 00000100:00100000:1.0:1782480778.815858:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:1.0:1782480778.815868:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+11:10361:x1869066291675776:12345-192.168.204.51@tcp:101:stat.0 00010000:00010000:1.0:1782480778.815906:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480778.815927:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c023e42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f8bd expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.816012:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c023e49 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.816221:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c023e49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.816234:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c023e49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.816250:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c023e50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.816257:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c023e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.816264:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c023e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.816622:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c023e57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.816635:0:10450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e26 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8b6 expref: 12 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.816643:0:10450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c023e57 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.816679:0:10450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8b6 expref: 12 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.816705:0:10450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8b6 expref: 12 pid: 11544 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480778.816720:0:10450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75542a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10450:1869066311630208:192.168.204.51@tcp:104: 00000100:00100000:1.0:1782480778.817463:0:10450:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d487f60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480778.820881:0:10450:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75542a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10450:1869066311630208:192.168.204.51@tcp:104: 00010000:00010000:1.0:1782480778.820922:0:10450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c023e57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480778.822934:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480778.823146:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291676032 00000100:00100000:1.0:1782480778.823156:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291676032 00000100:00100000:1.0:1782480778.823217:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:1.0:1782480778.823228:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+13:5581:x1869066291676032:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1782480778.823662:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+14:5581:x1869066291676032:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 435us (735us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1782480778.823671:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:2.0:1782480778.826482:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480778.826592:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291676160 00000100:00100000:0.0:1782480778.826602:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291676160 00010000:00010000:0.0:1782480778.826642:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8b6 expref: 14 pid: 11544 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480778.826684:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:0.0:1782480778.826693:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+14:2366:x1869066291676160:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480778.826708:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480778.826715:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8b6 expref: 14 pid: 11544 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.826738:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8b6 expref: 14 pid: 11544 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.826819:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e26 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8b6 expref: 14 pid: 11544 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.826845:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:0.0:1782480778.826851:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c023e57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.826860:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c023e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.826869:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c023e57 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.826913:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480778.826963:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+13:2366:x1869066291676160:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 270us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480778.826970:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00010000:00010000:3.0:1782480778.827036:0:10450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c023e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.827052:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c023e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480778.827094:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1782480778.827098:0:10450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480778.827131:0:10450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c023e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.827142:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c023e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.827152:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c023e49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.827158:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c023e49 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.827164:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c023e49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.827170:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572600 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480778.827174:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c023e49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.827181:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c023e49 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.827190:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:3.0:1782480778.827192:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480778.827196:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c023e49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.827212:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c023e49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.827224:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c023e50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.827231:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c023e50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.827236:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c023e50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.827241:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480778.827244:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c023e50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.827249:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c023e50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.827256:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d5230f800) 00010000:00010000:3.0:1782480778.827259:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480778.827262:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c023e50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.827266:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c023e50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.827300:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c023e42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8bd expref: 13 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.827325:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c023e57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8bd expref: 12 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.827332:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:3.0:1782480778.827335:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480778.827337:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573200, rc 0) 00000100:00100000:3.0:1782480778.827364:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+12:10361:x1869066291675776:12345-192.168.204.51@tcp:101:stat.0 Request processed in 11497us (11732us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480778.827371:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:3.0:1782480778.889577:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480778.889683:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291676416 00000100:00100000:0.0:1782480778.889692:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291676416 00000100:00100000:0.0:1782480778.889787:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:0.0:1782480778.889798:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+12:10367:x1869066291676416:12345-192.168.204.51@tcp:36:truncate.0 00010000:00010000:0.0:1782480778.890054:0:11544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480778.890082:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c023e57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8bd expref: 12 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.890101:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:0.0:1782480778.890106:0:11544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480778.890324:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.890338:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480778.890348:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782480778.890400:0:11544:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1782480778.890424:0:11544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c0133d41 reply state 0000000009a30b14 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480778.890433:0:11544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782480778.890549:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+14:10367:x1869066291676416:12345-192.168.204.51@tcp:36:truncate.0 Request processed in 752us (992us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1782480778.890567:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 54 00000020:00080000:0.0:1782480778.890573:0:11544:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782480778.897157:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.897175:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.897183:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.897189:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2dc00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480778.897195:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.897202:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.897219:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:3.0:1782480778.897222:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480778.897240:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480778.897247:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c023e5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480778.935155:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480779.016000:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480779.016233:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291676544 00000100:00100000:2.0:1782480779.016244:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291676544 00000100:00100000:2.0:1782480779.016323:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:2.0:1782480779.016335:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+13:10381:x1869066291676544:12345-192.168.204.51@tcp:101:stat.0 00010000:00010000:2.0:1782480779.016362:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480779.016384:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023e65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f8c4 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.016453:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023e6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.016468:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023e6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.016478:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023e6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.016491:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023e73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.016498:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023e73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.016504:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023e73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782480779.016915:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782480779.017055:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023e7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.017076:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.017085:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480779.017123:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1782480779.017127:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480779.017148:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.017160:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.017170:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023e6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.017177:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023e6c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.017185:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023e6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.017191:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8a00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480779.017196:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023e6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.017203:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023e6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.017216:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:2.0:1782480779.017224:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480779.017230:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023e6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.017237:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023e6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.017250:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023e73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.017257:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023e73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.017264:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023e73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.017270:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9600 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480779.017273:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023e73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.017279:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023e73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.017287:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d45d62e00) 00010000:00010000:2.0:1782480779.017290:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480779.017293:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023e73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.017299:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023e73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.017330:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023e65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8c4 expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.017358:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8c4 expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.017365:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:2.0:1782480779.017367:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782480779.017369:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9200, rc 0) 00000100:00100000:2.0:1782480779.017497:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+14:10381:x1869066291676544:12345-192.168.204.51@tcp:101:stat.0 Request processed in 1164us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480779.017506:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:2.0:1782480779.101087:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480779.101645:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291676800 00000100:00100000:3.0:1782480779.101657:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291676800 00000100:00100000:3.0:1782480779.101723:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:3.0:1782480779.101733:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+14:10391:x1869066291676800:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1782480779.101806:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480779.101838:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023e81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f8cb expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480779.102103:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1782480779.102289:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023e81 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8cb expref: 16 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.102305:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddce00) 00010000:00010000:3.0:1782480779.102308:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782480779.102313:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023e81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8cb expref: 16 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.102326:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ec000, rc 0) 00000100:00100000:2.0:1782480779.102719:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+15:10391:x1869066291676800:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 984us (1638us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1782480779.102727:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:0.0:1782480779.107105:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480779.107200:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291677056 00000100:00100000:1.0:1782480779.107211:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291677056 00000100:00100000:1.0:1782480779.107272:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:1.0:1782480779.107282:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+15:10391:x1869066291677056:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1782480779.107772:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+16:10391:x1869066291677056:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 464us (649us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1782480779.107782:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:3.0:1782480779.177783:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480779.177932:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291677312 00000100:00100000:0.0:1782480779.177942:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291677312 00000100:00100000:0.0:1782480779.178008:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:0.0:1782480779.178018:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+16:10397:x1869066291677312:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1782480779.178042:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480779.178062:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023e8f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f8d2 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.178160:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023e96 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.178192:0:11544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023e7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8c4 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.178202:0:11544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023e96 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.178235:0:11544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8c4 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.178248:0:11544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023e7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8c4 expref: 17 pid: 5808 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480779.178262:0:11544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ae94380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11544:1869066311630336:192.168.204.51@tcp:104: 00000100:00100000:0.0:1782480779.178375:0:11544:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45cf8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782480779.184316:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480779.184510:0:11544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ae94380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11544:1869066311630336:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480779.184546:0:11544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023e96 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480779.184640:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291677440 00000100:00100000:1.0:1782480779.184647:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291677440 00010000:00010000:1.0:1782480779.184687:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023e7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8c4 expref: 18 pid: 5808 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480779.184738:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:1.0:1782480779.184783:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+18:2366:x1869066291677440:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480779.184799:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480779.184806:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023e7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8c4 expref: 18 pid: 5808 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.185074:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8c4 expref: 18 pid: 5808 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.185099:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023e7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8c4 expref: 18 pid: 5808 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.185116:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:1.0:1782480779.185122:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023e96 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.185132:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023e96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.185139:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023e96 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.185253:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480779.185310:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+17:2366:x1869066291677440:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 563us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480779.185330:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00010000:00010000:0.0:1782480779.187504:0:11544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023e96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.187520:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023e96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480779.187544:0:11544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1782480779.188004:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c023e8f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8d2 expref: 18 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.188050:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023e96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8d2 expref: 17 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.188059:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:0.0:1782480779.188062:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782480779.188065:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2c200, rc 0) 00000100:00100000:0.0:1782480779.188173:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+17:10397:x1869066291677312:12345-192.168.204.51@tcp:101:bash.0 Request processed in 10155us (10434us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1782480779.188182:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:2.0:1782480779.193990:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480779.194089:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291677696 00000100:00100000:3.0:1782480779.194100:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291677696 00000100:00100000:3.0:1782480779.194193:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:3.0:1782480779.194204:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+17:10397:x1869066291677696:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:3.0:1782480779.194497:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023ea4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.194515:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.194526:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782480779.194592:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1782480779.194619:0:5809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000afff1f3 reply state 000000004be470c4 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480779.194629:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782480779.194736:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+20:10397:x1869066291677696:12345-192.168.204.51@tcp:36:bash.0 Request processed in 533us (753us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1782480779.194743:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 58 00000020:00080000:3.0:1782480779.194779:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782480779.202138:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.202156:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023ea4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.202164:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023ea4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.202171:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ec000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480779.202176:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023ea4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.202203:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023ea4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.202220:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:2.0:1782480779.202223:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480779.202228:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023ea4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480779.202234:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c023ea4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480779.204245:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480779.204412:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291677824 00000100:00100000:0.0:1782480779.204423:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291677824 00000100:00100000:0.0:1782480779.204509:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:0.0:1782480779.204520:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+19:10397:x1869066291677824:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1782480779.204545:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480779.204575:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c023eab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f8d9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.204669:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c023eb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.204684:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023e96 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8d2 expref: 20 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.204693:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c023eb2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.204736:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023e96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8d2 expref: 20 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.204794:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023e96 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8d2 expref: 20 pid: 11544 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480779.204808:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ae94380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1869066311630464:192.168.204.51@tcp:104: 00000100:00100000:0.0:1782480779.205109:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45cf8780 going to sleep for 11 seconds 00000100:00100000:1.0:1782480779.208278:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480779.208397:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ae94380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1869066311630464:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480779.208427:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c023eb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480779.208616:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291677952 00000100:00100000:3.0:1782480779.208624:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291677952 00010000:00010000:3.0:1782480779.208661:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023e96 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8d2 expref: 21 pid: 11544 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480779.208698:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:3.0:1782480779.208717:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75542a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+21:2366:x1869066291677952:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480779.208731:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480779.208737:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023e96 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8d2 expref: 21 pid: 11544 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.208806:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023e96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8d2 expref: 21 pid: 11544 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.208829:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c023e96 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8d2 expref: 21 pid: 11544 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.208844:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:3.0:1782480779.208849:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c023eb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.208857:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c023eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.208865:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c023eb2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.208882:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480779.208949:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75542a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+20:2366:x1869066291677952:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 234us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480779.208957:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 41 00010000:00010000:0.0:1782480779.209216:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c023eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.209225:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c023eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480779.209274:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1782480779.209279:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480779.209300:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c023eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.209330:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c023eab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8d9 expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.209358:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c023eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8d9 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.209366:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:0.0:1782480779.209375:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782480779.209379:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2d000, rc 0) 00000100:00100000:0.0:1782480779.209414:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+19:10397:x1869066291677824:12345-192.168.204.51@tcp:101:bash.0 Request processed in 4896us (5180us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480779.209422:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:1.0:1782480779.214058:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480779.214160:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291678208 00000100:00100000:0.0:1782480779.214170:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291678208 00000100:00100000:0.0:1782480779.214260:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:0.0:1782480779.214271:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45d55450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+19:10397:x1869066291678208:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:0.0:1782480779.214517:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45d55450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+20:10397:x1869066291678208:12345-192.168.204.51@tcp:35:bash.0 Request processed in 247us (813us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1782480779.214526:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:3.0:1782480779.302292:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480779.302482:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291678464 00000100:00100000:0.0:1782480779.302492:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291678464 00000100:00100000:0.0:1782480779.302563:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:0.0:1782480779.302573:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+20:10407:x1869066291678464:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1782480779.302599:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480779.302618:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c023eb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f8e0 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480779.302946:0:11544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1782480779.303119:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c023eb9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8e0 expref: 22 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.303134:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddce00) 00010000:00010000:0.0:1782480779.303137:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782480779.303142:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c023eb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8e0 expref: 22 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.303165:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2ca00, rc 0) 00000100:00100000:0.0:1782480779.303225:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+21:10407:x1869066291678464:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 652us (943us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1782480779.303233:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:2.0:1782480779.310641:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480779.310736:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291678592 00000100:00100000:3.0:1782480779.310775:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291678592 00000100:00100000:3.0:1782480779.310846:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:3.0:1782480779.310855:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+21:10407:x1869066291678592:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:3.0:1782480779.310950:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023ec7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.310985:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023ec7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.310998:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023ec7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311013:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ece lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311021:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311027:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311362:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023ed5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311372:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311380:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782480779.311421:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311434:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023ec7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311440:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023ec7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311459:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023ec7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311465:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ed800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480779.311469:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023ec7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311476:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023ec7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311486:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:3.0:1782480779.311490:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480779.311494:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023ec7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311500:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023ec7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311512:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ece lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311519:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ece lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311525:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ece lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311530:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821edc00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480779.311533:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ece lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311560:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ece lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311569:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d4bddcd00) 00010000:00010000:3.0:1782480779.311571:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480779.311574:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ece lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311580:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ece lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311594:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311600:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023ed5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311606:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311610:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ec800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480779.311613:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311619:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023ed5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311626:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:3.0:1782480779.311628:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480779.311631:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023ed5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.311646:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023ed5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480779.311714:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+21:10407:x1869066291678592:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 858us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480779.311723:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:1.0:1782480779.314852:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480779.315024:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291678848 00000100:00100000:3.0:1782480779.315035:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291678848 00000100:00100000:3.0:1782480779.315081:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:3.0:1782480779.315090:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+21:10407:x1869066291678848:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1782480779.315526:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+22:10407:x1869066291678848:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 435us (685us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1782480779.315534:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:0.0:1782480779.351458:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480779.351560:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291679104 00000100:00100000:3.0:1782480779.351569:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291679104 00000100:00100000:3.0:1782480779.351629:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:3.0:1782480779.351638:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+22:10410:x1869066291679104:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1782480779.351661:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480779.351681:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023edc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f8e7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.351788:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ee3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.351802:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.351840:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.351856:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023eea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.351862:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.351868:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.352405:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023ef1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.352416:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.352424:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480779.352435:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1782480779.352527:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ee3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.352534:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ee3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.352540:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.352558:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821edc00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480779.352569:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ee3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.352577:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ee3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.352590:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:3.0:1782480779.352593:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480779.352597:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ee3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.352603:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c023ee3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.352617:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023eea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.352624:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023eea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.352629:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023eea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.352634:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ed800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480779.352636:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023eea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.352642:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023eea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.352650:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d4bddcd00) 00010000:00010000:3.0:1782480779.352652:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480779.352661:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023eea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.352667:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023eea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.352711:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023edc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8e7 expref: 25 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.352724:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8e7 expref: 24 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.352731:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:3.0:1782480779.352733:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480779.352735:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ecc00, rc 0) 00000100:00100000:3.0:1782480779.352980:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+24:10410:x1869066291679104:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1342us (1529us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1782480779.352989:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:2.0:1782480779.356986:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480779.357253:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291679232 00000100:00100000:1.0:1782480779.357264:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291679232 00000100:00100000:1.0:1782480779.357325:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:1.0:1782480779.357335:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+24:10410:x1869066291679232:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:1.0:1782480779.357402:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023eff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.357419:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023eff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.357430:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023eff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.357456:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023eff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.357462:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023eff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.357469:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023eff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.357475:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573a00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480779.357479:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023eff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.357505:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023eff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.357518:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:1.0:1782480779.357521:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782480779.357525:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023eff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.357531:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023eff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480779.357622:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+24:10410:x1869066291679232:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 287us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480779.357629:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:1.0:1782480779.360128:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480779.360205:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291679360 00000100:00100000:3.0:1782480779.360214:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291679360 00000100:00100000:3.0:1782480779.360275:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:3.0:1782480779.360287:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48577b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+24:2369:x1869066291679360:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480779.360304:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480779.360329:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023ef1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8e7 expref: 24 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.360346:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:3.0:1782480779.360352:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480779.360417:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48577b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+23:2369:x1869066291679360:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 133us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480779.360425:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:0.0:1782480779.362008:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480779.362085:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291679616 00000100:00100000:3.0:1782480779.362093:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291679616 00000100:00100000:3.0:1782480779.362137:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:3.0:1782480779.362147:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+23:10410:x1869066291679616:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1782480779.362366:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+24:10410:x1869066291679616:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 219us (362us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1782480779.362373:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:3.0:1782480779.494737:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480779.494876:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291679872 00000100:00100000:0.0:1782480779.494898:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291679872 00000100:00100000:0.0:1782480779.494966:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:0.0:1782480779.494977:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+24:10428:x1869066291679872:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:0.0:1782480779.495006:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480779.495027:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c023f06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f8ee expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.495131:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c023f0d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.495146:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c023f0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.495157:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c023f0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480779.495169:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1782480779.495305:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c023f06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8ee expref: 27 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.495349:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c023f0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8ee expref: 26 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.495359:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:0.0:1782480779.495362:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782480779.495366:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2d600, rc 0) 00000100:00100000:0.0:1782480779.495433:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+26:10428:x1869066291679872:12345-192.168.204.51@tcp:101:cat.0 Request processed in 458us (706us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1782480779.495440:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:1.0:1782480779.529372:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480779.529508:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291680000 00000100:00100000:3.0:1782480779.529518:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291680000 00000100:00100000:3.0:1782480779.529588:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:3.0:1782480779.529598:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+26:10429:x1869066291680000:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1782480779.529623:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480779.529642:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023f1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f8f5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.529769:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023f22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.529783:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.529794:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480779.530216:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1782480779.530229:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480779.530310:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.530340:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023f1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8f5 expref: 28 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.530359:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023f22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8f5 expref: 27 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.530368:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:3.0:1782480779.530372:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782480779.530375:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ec800, rc 0) 00000100:00100000:3.0:1782480779.530448:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+27:10429:x1869066291680000:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 850us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480779.530456:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:3.0:1782480779.536901:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480779.537046:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291680384 00000100:00100000:0.0:1782480779.537055:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291680384 00000100:00100000:0.0:1782480779.537105:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:0.0:1782480779.537114:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+27:10429:x1869066291680384:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1782480779.537419:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+28:10429:x1869066291680384:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 306us (536us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1782480779.537427:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:2.0:1782480779.540959:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480779.541081:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291680512 00000100:00100000:3.0:1782480779.541090:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291680512 00000100:00100000:3.0:1782480779.541149:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:3.0:1782480779.541158:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+28:10429:x1869066291680512:12345-192.168.204.51@tcp:103:lfs.0 00010000:00010000:3.0:1782480779.541173:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782480779.541204:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c023eb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8d9 expref: 28 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.541226:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c023f0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8ee expref: 27 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.541257:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c023db6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f89a expref: 26 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.541267:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255a00) 00010000:00010000:3.0:1782480779.541276:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480779.541331:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+25:10429:x1869066291680512:12345-192.168.204.51@tcp:103:lfs.0 Request processed in 174us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480779.541338:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:2.0:1782480779.545210:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480779.545452:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291680640 00000100:00100000:3.0:1782480779.545462:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291680640 00000100:00100000:3.0:1782480779.545526:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:3.0:1782480779.545537:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+25:10429:x1869066291680640:12345-192.168.204.51@tcp:58:lfs.0 00010000:00010000:3.0:1782480779.545690:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023f29 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.545717:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023f29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.545730:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023f29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782480779.546439:0:5809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782480779.546670:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1782480779.546739:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1782480779.547688:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+25:10429:x1869066291680640:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 2145us (2477us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480779.547712:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:0.0:1782480779.574441:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480779.574570:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291680768 00000100:00100000:1.0:1782480779.574582:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291680768 00000100:00100000:1.0:1782480779.574654:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:1.0:1782480779.574664:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+25:10431:x1869066291680768:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1782480779.574690:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480779.574725:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023f30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f8fc expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.574849:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f37 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.574865:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.574891:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.574919:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c023f3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.574926:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c023f3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.574932:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c023f3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.575258:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c023f45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.575268:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c023f45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.575275:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c023f45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480779.575311:0:11544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1782480779.575315:0:11544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782480779.575333:0:11544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c023f45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.575344:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c023f45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.575352:0:11544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.575367:0:11544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f37 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.575374:0:11544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.575380:0:11544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480779.575385:0:11544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.575393:0:11544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f37 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.575406:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:1.0:1782480779.575409:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480779.575413:0:11544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.575419:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.575433:0:11544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c023f3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.575439:0:11544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c023f3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.575445:0:11544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c023f3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.575449:0:11544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572c00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480779.575465:0:11544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c023f3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.575470:0:11544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c023f3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.575478:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d5230f200) 00010000:00010000:1.0:1782480779.575481:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480779.575483:0:11544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c023f3e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.575489:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c023f3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.575522:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023f30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8fc expref: 27 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.575534:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c023f45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8fc expref: 26 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.575554:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d4bddcd00) 00010000:00010000:1.0:1782480779.575556:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782480779.575559:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572800, rc 0) 00000100:00100000:1.0:1782480779.575639:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+26:10431:x1869066291680768:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 975us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480779.575646:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 67 00000040:00080000:1.0:1782480779.767261:0:11541:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782480779.767272:0:11541:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782480779.767320:0:11541:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1782480779.767327:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782480779.767460:0:11541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11541:1869066311630592:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782480779.769547:0:11541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d487f6600 going to sleep for 11 seconds 00000100:00100000:0.0:1782480779.778811:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480779.778906:0:5819:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291680896 00000100:00100000:3.0:1782480779.778916:0:5819:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291680896 00000100:00100000:3.0:1782480779.778974:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:3.0:1782480779.778984:0:5819:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:49099535-dcd3-436f-aa96-9770a3f52e5b+27:10442:x1869066291680896:12345-192.168.204.51@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1782480779.779061:0:5819:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:49099535-dcd3-436f-aa96-9770a3f52e5b+27:10442:x1869066291680896:12345-192.168.204.51@tcp:900:lhsmtool_posix.0 Request processed in 78us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480779.779069:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:1.0:1782480779.779486:0:11541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11541:1869066311630592:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782480779.791704:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480779.791927:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291681024 00000100:00100000:0.0:1782480779.791937:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291681024 00000100:00100000:0.0:1782480779.791996:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:0.0:1782480779.792006:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+26:10442:x1869066291681024:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782480779.792058:0:5807:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782480779.792170:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+26:10442:x1869066291681024:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 164us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480779.792183:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:3.0:1782480779.808470:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480779.808679:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291681152 00000100:00100000:0.0:1782480779.808688:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291681152 00000100:00100000:0.0:1782480779.808744:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:0.0:1782480779.808777:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+26:10442:x1869066291681152:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1782480779.808861:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c023f4c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.808877:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c023f4c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.808889:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c023f4c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.808914:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c023f53 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809298:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c023f53 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809307:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c023f53 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809337:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c023f5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809345:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c023f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809351:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c023f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480779.809401:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1782480779.809405:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480779.809421:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c023f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809433:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c023f4c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809439:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c023f4c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809446:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c023f4c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809452:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2d400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480779.809456:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c023f4c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809463:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c023f4c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809475:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d4bddc700) 00010000:00010000:0.0:1782480779.809478:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480779.809482:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c023f4c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809488:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c023f4c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809501:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c023f53 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809517:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c023f53 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809523:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c023f53 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809527:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2de00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480779.809530:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c023f53 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809546:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c023f53 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809556:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9b6d43255700) 00010000:00010000:0.0:1782480779.809559:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480779.809562:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c023f53 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809568:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c023f53 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809584:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c023f5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809590:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c023f5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809595:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c023f5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809600:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2da00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480779.809609:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c023f5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809616:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c023f5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809624:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d4bddcd00) 00010000:00010000:0.0:1782480779.809626:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480779.809629:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c023f5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.809635:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c023f5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480779.811207:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+26:10442:x1869066291681152:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 Request processed in 2421us (2736us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480779.811220:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:3.0:1782480779.821213:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480779.821334:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291681408 00000100:00100000:1.0:1782480779.821344:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291681408 00000100:00100000:1.0:1782480779.821394:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:1.0:1782480779.821404:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+26:10442:x1869066291681408:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480779.821426:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480779.821445:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c023f61 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f903 expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.821554:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.821568:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.821581:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480779.821593:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1782480779.821689:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.821698:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.821704:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.821720:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480779.821725:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.821733:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.821762:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d4bddcd00) 00010000:00010000:1.0:1782480779.821765:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782480779.821770:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.821777:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.823383:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c023f61 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f903 expref: 28 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.823402:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d4bddc700) 00010000:00010000:1.0:1782480779.823406:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782480779.823411:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c023f61 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f903 expref: 28 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.823424:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572c00, rc 0) 00000100:00100000:1.0:1782480779.823488:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+27:10442:x1869066291681408:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 2084us (2285us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1782480779.823498:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:1.0:1782480779.828845:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480779.829075:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291681536 00000100:00100000:2.0:1782480779.829096:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291681536 00000100:00100000:2.0:1782480779.829156:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:2.0:1782480779.829168:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+27:10442:x1869066291681536:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782480779.829211:0:5808:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782480779.829316:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+27:10442:x1869066291681536:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 150us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480779.829324:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:3.0:1782480779.832564:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480779.837265:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291681792 00000100:00100000:1.0:1782480779.837280:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291681792 00000100:00100000:1.0:1782480779.837350:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:1.0:1782480779.837361:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+27:10442:x1869066291681792:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480779.837381:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480779.837384:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782480779.837410:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c023f22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8f5 expref: 27 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.837428:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:1.0:1782480779.837433:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782480779.837446:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c023f76 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f90a expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782480779.838660:0:5809:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1782480779.839457:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.839477:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.839490:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.839570:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c023f76 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f90a expref: 29 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.839590:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f90a expref: 28 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.839615:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d5230f200) 00010000:00010000:1.0:1782480779.839619:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782480779.839622:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572000, rc 0) 00000100:00100000:1.0:1782480779.839709:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+28:10442:x1869066291681792:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 2349us (7153us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1782480779.839718:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:3.0:1782480779.848973:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480779.849213:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291682048 00000100:00100000:1.0:1782480779.849225:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291682048 00000100:00100000:1.0:1782480779.849289:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:1.0:1782480779.849299:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+28:10442:x1869066291682048:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782480779.849387:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480779.849413:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c023f7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f90a expref: 28 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.849435:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d5230f200) 00010000:00010000:1.0:1782480779.849446:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782480779.849469:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023f8b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.849484:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023f8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.849494:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023f8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.849568:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023f92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf3bdeab8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.849587:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023f92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf3bdeab8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.849595:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023f92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf3bdeab8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.849888:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023f8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.849897:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023f8b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.849904:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023f8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.849909:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573a00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480779.849914:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023f8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.850006:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023f8b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.850016:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:1.0:1782480779.850019:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480779.850023:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023f8b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.850029:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c023f8b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.850039:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023f92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf3bdeab8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.850051:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023f92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf3bdeab8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.850057:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023f92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf3bdeab8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.850062:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480779.850065:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023f92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf3bdeab8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.850072:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023f92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf3bdeab8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.850165:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf3bdeab8 (ffff9b6d5230fe00) 00010000:00010000:1.0:1782480779.850169:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480779.850172:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023f92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf3bdeab8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.850178:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c023f92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf3bdeab8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480779.850265:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+27:10442:x1869066291682048:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 966us (1303us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782480779.850274:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:2.0:1782480779.862596:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480779.862678:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291682176 00000100:00100000:1.0:1782480779.862696:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291682176 00000100:00100000:1.0:1782480779.862783:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00100000:1.0:1782480779.862793:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+27:10442:x1869066291682176:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480779.862825:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480779.862862:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c023f99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f911 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.862898:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c023fa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.862911:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c023fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.863092:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c023fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.863187:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c023f99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f911 expref: 29 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.863206:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c023fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f911 expref: 28 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.863214:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d5230fb00) 00010000:00010000:1.0:1782480779.863217:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782480779.863220:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573c00, rc 0) 00000100:00100000:1.0:1782480779.863283:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+28:10442:x1869066291682176:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 491us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480779.863290:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00100000:2.0:1782480779.867861:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480779.868106:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291682432 00000100:00100000:1.0:1782480779.868116:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291682432 00000100:00100000:1.0:1782480779.868178:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:1.0:1782480779.868188:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+28:10442:x1869066291682432:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782480779.868274:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c023fa7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.868302:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c023fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480779.868314:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c023fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782480779.868611:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1782480779.868622:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 400709874341ns, next at 401709872181ns, rc = 0 00000004:00010000:1.0:1782480779.868721:0:5809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000c8f2ef9 reply state 00000000d4333522 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c023fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480779.868731:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782480779.868864:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+30:10442:x1869066291682432:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 676us (1013us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1782480779.868873:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 75 00010000:00010000:0.0:1782480779.872051:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c023fa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.872069:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c023fa7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.872085:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c023fa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.872091:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572e00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480779.872097:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c023fa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.872105:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c023fa7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.872141:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d5230fb00) 00010000:00010000:0.0:1782480779.872144:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782480779.872149:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c023fa7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480779.872156:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c023fa7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480779.874022:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480779.874220:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291682560 00000100:00100000:3.0:1782480779.874230:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291682560 00000100:00100000:3.0:1782480779.874289:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:3.0:1782480779.874299:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+29:10442:x1869066291682560:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480779.874325:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480779.874348:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023fae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f918 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.874410:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023fae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f918 expref: 30 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.874424:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023fae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f918 expref: 30 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480779.874444:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d5230fb00) 00010000:00010000:3.0:1782480779.874459:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782480779.874464:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ed800, rc 0) 00000100:00100000:3.0:1782480779.874529:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+30:10442:x1869066291682560:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 231us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480779.874545:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:3.0:1782480779.880524:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480779.885519:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291682688 00000100:00100000:2.0:1782480779.885561:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291682688 00000100:00100000:2.0:1782480779.885613:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:2.0:1782480779.885621:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2365:x1869066291682688:12345-192.168.204.51@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1782480779.885656:0:6602:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp t0 exp 0000000000000000 cur 400 last 0 00000020:00000080:2.0:1782480779.885689:0:6602:0:(genops.c:1406:class_connect()) connect: client 49099535-dcd3-436f-aa96-9770a3f52e5b, cookie 0x3dc3ebf33c023fb5 00002000:00100000:2.0:1782480779.885701:0:6602:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 49099535-dcd3-436f-aa96-9770a3f52e5b/ffff9b6d74c72000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211365f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782480779.885724:0:6602:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782480779.886281:0:6602:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782480779.886314:0:6602:0:(import.c:65:import_set_state_nolock()) ffff9b6d7f381800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782480779.886381:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2365:x1869066291682688:12345-192.168.204.51@tcp:8:lhsmtool_posix.0 Request processed in 758us (5867us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480779.886390:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:2.0:1782480779.893642:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480779.900782:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291682816 00000100:00100000:1.0:1782480779.900802:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291682816 00000100:00100000:2.0:1782480779.901015:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:2.0:1782480779.901026:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:0:x1869066291682816:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1782480779.901650:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1782480779.967862:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1782480779.967883:0:7497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 49099535-dcd3-436f-aa96-9770a3f52e5b 00000100:00100000:2.0:1782480779.968566:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+5:0:x1869066291682816:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 67534us (74928us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782480779.968578:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 26 00010000:00010000:1.0:1782480779.971191:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480779.975062:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480779.975246:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291683072 00000100:00100000:3.0:1782480779.975255:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291683072 00000100:00100000:3.0:1782480779.975308:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:3.0:1782480779.975318:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+30:10442:x1869066291683072:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782480779.977018:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+31:10442:x1869066291683072:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 1692us (1952us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1782480779.977029:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:0.0:1782480779.991285:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480779.991371:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291683328 00000100:00100000:1.0:1782480779.991381:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291683328 00000100:00100000:1.0:1782480779.991442:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:1.0:1782480779.991452:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+31:10442:x1869066291683328:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782480779.991590:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+31:10442:x1869066291683328:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 139us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480779.991598:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:2.0:1782480780.000922:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480780.001340:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291683456 00000100:00100000:0.0:1782480780.001349:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291683456 00000100:00100000:0.0:1782480780.001408:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:0.0:1782480780.001419:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+31:10442:x1869066291683456:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782480780.001439:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480780.001459:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c023fbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f91f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.001528:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c023fc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.001558:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c023fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.001581:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c023fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480780.001638:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480780.001659:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c023fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.001688:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c023fbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f91f expref: 33 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.001709:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c023fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f91f expref: 32 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.001719:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d5230fb00) 00010000:00010000:0.0:1782480780.001722:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1782480780.001725:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2d600, rc 0) 00000100:00100000:0.0:1782480780.001829:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+32:10442:x1869066291683456:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 411us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480780.001837:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:0.0:1782480780.010525:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480780.012883:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291683584 00000100:00100000:2.0:1782480780.012899:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291683584 00000100:00100000:2.0:1782480780.012991:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:2.0:1782480780.013002:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2366:x1869066291683584:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782480780.013021:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480780.013046:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c023fca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f926 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782480780.013088:0:6602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3e7f8c, blocks: 0x1 00010000:00010000:2.0:1782480780.013107:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=400s v=(0 0) 00010000:00010000:2.0:1782480780.013112:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480780.013121:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c023fca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f926 expref: 6 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.013141:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c023fca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f926 expref: 6 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.013155:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e8400, rc 0) 00000100:00100000:2.0:1782480780.013222:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2366:x1869066291683584:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 221us (2705us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480780.013229:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:3.0:1782480780.028864:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480780.028977:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291683840 00000100:00100000:1.0:1782480780.028987:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291683840 00000100:00100000:1.0:1782480780.029059:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:1.0:1782480780.029070:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+32:10442:x1869066291683840:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782480780.029171:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+32:10442:x1869066291683840:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 103us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480780.029179:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:1.0:1782480780.045124:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480780.045259:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291683968 00000100:00100000:3.0:1782480780.045270:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291683968 00000100:00100000:3.0:1782480780.045340:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:3.0:1782480780.045351:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:10442:x1869066291683968:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480780.045371:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480780.045392:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e819c2b/0x3dc3ebf33c023fd1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f92d expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480780.045423:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c023fca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f926 expref: 7 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480780.045433:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480780.045447:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480780.045453:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e819c2b/0x3dc3ebf33c023fd1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f92d expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480780.045502:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c023fca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f926 expref: 7 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480780.045517:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c023fca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f926 expref: 7 pid: 6602 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480780.045541:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f12e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6605:1869066311630720:192.168.204.51@tcp:104: 00000100:00100000:3.0:1782480780.045638:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75626240 going to sleep for 11 seconds 00000100:00100000:0.0:1782480780.050077:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480780.050464:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291684096 00000100:00100000:1.0:1782480780.050474:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291684096 00010000:00010000:1.0:1782480780.050514:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c023fca lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f926 expref: 8 pid: 6602 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480780.050556:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:1.0:1782480780.050565:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d465fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2366:x1869066291684096:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480780.050580:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480780.050602:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c023fca lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f926 expref: 8 pid: 6602 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.050616:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c023fca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f926 expref: 8 pid: 6602 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.050639:0:8304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480780.050644:0:8304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480780.050652:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000e819c2b/0x3dc3ebf33c023fd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f92d expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.050662:0:8304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e819c2b/0x3dc3ebf33c023fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f92d expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.050731:0:8304:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000e819c2b/0x3dc3ebf33c023fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f92d expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480780.050767:0:8304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d757c5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8304:1869066311630848:192.168.204.51@tcp:105: 00000100:00100000:1.0:1782480780.050859:0:8304:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d487f6600 going to sleep for 11 seconds 00010000:00010000:3.0:1782480780.051220:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c023fca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f926 expref: 8 pid: 6602 timeout: 500 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480780.051236:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f12e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6605:1869066311630720:192.168.204.51@tcp:104: 00010000:00010000:3.0:1782480780.051273:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000e819c2b/0x3dc3ebf33c023fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f92d expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480780.051285:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821edc00, rc 0) 00000100:00100000:3.0:1782480780.051327:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+7:10442:x1869066291683968:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 5978us (6213us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480780.051336:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:0.0:1782480780.063525:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480780.063582:0:8304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d757c5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8304:1869066311630848:192.168.204.51@tcp:105: 00010000:00010000:3.0:1782480780.063607:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480780.063696:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d465fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2366:x1869066291684096:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 13130us (13627us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480780.063716:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:2.0:1782480780.068809:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291684224 00000100:00100000:2.0:1782480780.068825:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291684224 00002000:00100000:2.0:1782480780.068882:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9b6d7fc12680 x1869066291684224/t0(0) o4->49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp:536/0 lens 504/0 e 0 to 0 dl 1782480791 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782480780.068895:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d7fc12680 with x1869066291684224 ext(0->8) 00002000:00010000:2.0:1782480780.068901:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d7fc12680 00000100:00100000:2.0:1782480780.068938:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:2.0:1782480780.068948:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2367:x1869066291684224:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1782480780.069567:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2367:x1869066291684224:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 Request processed in 619us (6050us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1782480780.069583:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00002000:00100000:2.0:1782480780.069590:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9b6d7fc12680 x1869066291684224/t4294967302(0) o4->49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp:536/0 lens 504/448 e 0 to 0 dl 1782480791 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782480780.069598:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d7fc12680 with x1869066291684224 ext(0->8) 00002000:00010000:2.0:1782480780.069602:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d7fc12680 00000100:00100000:0.0:1782480780.075549:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480780.075841:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291684352 00000100:00100000:2.0:1782480780.075851:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291684352 00000100:00100000:2.0:1782480780.075913:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:2.0:1782480780.075924:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+32:10442:x1869066291684352:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1782480780.168193:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+32:10442:x1869066291684352:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 Request processed in 92258us (92652us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480780.168209:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 80 00000001:00080000:3.0:1782480780.170009:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000001:00080000:3.0:1782480780.170041:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:3.0:1782480780.170045:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000001:00080000:3.0:1782480780.170075:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:3.0:1782480780.170093:0:5829:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1782480780.170220:0:5841:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1782480780.170231:0:5841:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1782480780.175680:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311630976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1782480780.175768:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480780.175844:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311630976 00000100:00100000:0.0:1782480780.175852:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311630976 00000100:00100000:0.0:1782480780.175910:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782480780.175920:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311630976:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1782480780.176097:0:8678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1782480780.176101:0:8678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782480780 00002000:00010000:0.0:1782480780.176103:0:8678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1782480780.176105:0:8678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1782480780 -> 1782480780 00002000:00010000:0.0:1782480780.176107:0:8678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1782480780.176147:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1869066311630976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 228us (379us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1782480780.176154:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1782480780.176176:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1782480780.176204:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d7fc10700/2, rc 0, transno 4294967303 00000100:00100000:0.0:1782480780.176210:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311630976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1782480780.177802:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480780.178176:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291684480 00000100:00100000:3.0:1782480780.178185:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291684480 00000100:00100000:3.0:1782480780.178248:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:3.0:1782480780.178258:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2369:x1869066291684480:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1782480780.253713:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1782480780.253737:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1782480780.255930:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2369:x1869066291684480:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 Request processed in 77662us (78129us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480780.255945:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:1.0:1782480780.264412:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480780.264653:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291684736 00000100:00100000:2.0:1782480780.264663:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291684736 00000100:00100000:2.0:1782480780.264726:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00100000:2.0:1782480780.264737:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+13:10442:x1869066291684736:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782480780.264819:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480780.264848:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c023fc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f91f expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.264879:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d5230fb00) 00010000:00010000:2.0:1782480780.264886:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782480780.264916:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023fd8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.264928:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.264937:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480780.265452:0:5807:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000064de5d03 reply state 00000000fcc3c639 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480780.265463:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782480780.265587:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+14:10442:x1869066291684736:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 851us (1185us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1782480780.265596:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 81 00010000:00010000:3.0:1782480780.279184:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480780.279206:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023fd8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480780.279215:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023fd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480780.279221:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8a00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480780.279227:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023fd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480780.279234:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023fd8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480780.279253:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d5230fb00) 00010000:00010000:3.0:1782480780.279257:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480780.279277:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023fd8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480780.279283:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c023fd8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480780.279550:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480780.280657:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291684864 00000100:00100000:3.0:1782480780.280671:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291684864 00000100:00100000:3.0:1782480780.280768:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:3.0:1782480780.280778:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2369:x1869066291684864:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1782480780.281038:0:8678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1782480780.281043:0:8678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1782480780 -> 1782480779 00002000:00010000:3.0:1782480780.281046:0:8678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1782480778 00002000:00010000:3.0:1782480780.281048:0:8678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1782480780 -> 1782480779 00002000:00010000:3.0:1782480780.281050:0:8678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1782480780.281117:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2369:x1869066291684864:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 340us (1572us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1782480780.281125:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:1.0:1782480780.287943:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480780.288242:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291685120 00000100:00100000:2.0:1782480780.288253:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291685120 00000100:00100000:2.0:1782480780.288395:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:2.0:1782480780.288406:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+13:10442:x1869066291685120:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1782480780.288572:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023fdf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.288590:0:10450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c023fa0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f911 expref: 13 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.288613:0:10450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023fdf lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.288650:0:10450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c023fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f911 expref: 13 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.288664:0:10450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c023fa0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f911 expref: 13 pid: 11544 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480780.288679:0:10450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b2be300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10450:1869066311631104:192.168.204.51@tcp:104: 00000100:00100000:2.0:1782480780.288797:0:10450:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6c42ca7240 going to sleep for 11 seconds 00000100:00100000:2.0:1782480780.292903:0:10450:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b2be300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10450:1869066311631104:192.168.204.51@tcp:104: 00010000:00010000:2.0:1782480780.292936:0:10450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023fdf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480780.297976:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480780.298681:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291685248 00000100:00100000:0.0:1782480780.298694:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291685248 00010000:00010000:0.0:1782480780.298797:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c023fa0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f911 expref: 14 pid: 11544 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480780.298856:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:0.0:1782480780.298867:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+14:2367:x1869066291685248:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480780.298883:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480780.298891:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c023fa0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f911 expref: 14 pid: 11544 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.298905:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c023fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f911 expref: 14 pid: 11544 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.298928:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c023fa0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f911 expref: 14 pid: 11544 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.298951:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d5230fb00) 00010000:00010000:0.0:1782480780.298956:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023fdf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.298965:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023fdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.298972:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023fdf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.298999:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480780.299051:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+13:2367:x1869066291685248:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 185us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480780.299059:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00010000:00010000:0.0:1782480780.299085:0:10450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023fdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.299092:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023fdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.299119:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023fdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.299126:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023fdf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.299133:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023fdf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.299138:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9600 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480780.299148:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023fdf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.299157:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023fdf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.299167:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d5230fb00) 00010000:00010000:0.0:1782480780.299169:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1782480780.299173:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023fdf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.299179:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c023fdf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480780.299217:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+12:10442:x1869066291685120:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 Request processed in 10812us (11283us total) trans 0 rc -22/-22 00000100:00100000:0.0:1782480780.299226:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:3.0:1782480780.306075:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480780.306157:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291685376 00000100:00100000:1.0:1782480780.306168:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291685376 00000100:00100000:1.0:1782480780.306232:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:1.0:1782480780.306243:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2366:x1869066291685376:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1782480780.306291:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023fe6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.306314:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000e819c2b/0x3dc3ebf33c023fd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f92d expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.306323:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1782480780.306338:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782480780.306343:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023fe6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.306405:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000e819c2b/0x3dc3ebf33c023fd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f92d expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.306421:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000e819c2b/0x3dc3ebf33c023fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f92d expref: 7 pid: 6605 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480780.306437:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d757c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6605:1869066311631232:192.168.204.51@tcp:104: 00000100:00100000:1.0:1782480780.306523:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d487f6480 going to sleep for 11 seconds 00000100:00100000:1.0:1782480780.312403:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d757c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6605:1869066311631232:192.168.204.51@tcp:104: 00010000:00010000:1.0:1782480780.312514:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023fe6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480780.323495:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480780.323605:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291685504 00000100:00100000:0.0:1782480780.323615:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291685504 00010000:00010000:0.0:1782480780.323654:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000e819c2b/0x3dc3ebf33c023fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f92d expref: 8 pid: 6605 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480780.323696:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:0.0:1782480780.323706:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2366:x1869066291685504:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480780.323721:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480780.323742:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000e819c2b/0x3dc3ebf33c023fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f92d expref: 8 pid: 6605 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.323776:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000e819c2b/0x3dc3ebf33c023fd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f92d expref: 8 pid: 6605 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.323829:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e819c2b/0x3dc3ebf33c023fd1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f92d expref: 8 pid: 6605 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.323846:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782480780.323850:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782480780.323857:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023fe6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.323868:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023fe6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.323896:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480780.323949:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2366:x1869066291685504:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 244us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480780.323956:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00010000:00010000:1.0:1782480780.324150:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023fe6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.324353:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023fe6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.324383:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023fe6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.324392:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023fe6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.324412:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023fe6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.324419:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572a00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480780.324423:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023fe6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.324886:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023fe6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.324910:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023fe6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.324919:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000677487aa/0x3dc3ebf33c023fe6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480780.325005:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2366:x1869066291685376:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 Request processed in 18761us (18937us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480780.325014:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:0.0:1782480780.337929:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480780.344392:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291685760 00000100:00100000:2.0:1782480780.344407:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291685760 00000100:00100000:2.0:1782480780.344551:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 83 00000100:00100000:2.0:1782480780.344564:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+12:10442:x1869066291685760:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782480780.344642:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023fed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.344660:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023fed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.344672:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023fed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.344953:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023ff4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.344965:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023fae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f918 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.344974:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023ff4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.346885:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023fae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f918 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.347057:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023fae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f918 expref: 13 pid: 5808 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480780.347076:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b2be300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1869066311631360:192.168.204.51@tcp:104: 00000100:00100000:2.0:1782480780.347165:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6c42ca7240 going to sleep for 11 seconds 00000100:00100000:2.0:1782480780.350409:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b2be300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1869066311631360:192.168.204.51@tcp:104: 00000100:00100000:3.0:1782480780.350435:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00010000:00010000:2.0:1782480780.350846:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023ff4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480780.365422:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291685888 00000100:00100000:0.0:1782480780.365438:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291685888 00010000:00010000:0.0:1782480780.365484:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023fae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f918 expref: 14 pid: 5808 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480780.365523:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:0.0:1782480780.365544:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+14:2366:x1869066291685888:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480780.365559:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480780.365567:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023fae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f918 expref: 14 pid: 5808 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.365590:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023fae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f918 expref: 14 pid: 5808 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.365614:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ed800/0x3dc3ebf33c023fae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f918 expref: 14 pid: 5808 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.365628:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d5230fb00) 00010000:00010000:0.0:1782480780.365634:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023ff4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.365644:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023ff4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.365652:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023ff4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.365681:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480780.365744:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+13:2366:x1869066291685888:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 200us (15310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480780.365772:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00010000:00010000:0.0:1782480780.366426:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023ff4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.366436:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023ff4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782480780.366643:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1782480780.368419:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1782480780.368503:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1782480780.368618:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5809:1869066311631488:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1782480780.368688:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480780.369370:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d460dc180 going to sleep for 11 seconds 00000100:00100000:2.0:1782480780.376684:0:5813:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311631488 00000100:00100000:2.0:1782480780.376699:0:5813:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311631488 00000100:00100000:2.0:1782480780.376958:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782480780.376970:0:5813:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5809:x1869066311631488:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782480780.377099:0:5813:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5809:x1869066311631488:12345-0@lo:1000:mdt00_002.0 Request processed in 132us (8410us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480780.377117:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782480780.377186:0:5809:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1782480780.377193:0:5809:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d7fc10700, transno 4294967303 00000100:00100000:0.0:1782480780.377210:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5809:1869066311631488:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1782480780.377778:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1782480780.377995:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d46048a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5809:1869066311631616:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1782480780.378036:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480780.383070:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae50600 going to sleep for 11 seconds 00000100:00100000:3.0:1782480780.386424:0:5812:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311631616 00000100:00100000:3.0:1782480780.386440:0:5812:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311631616 00000100:00100000:3.0:1782480780.386505:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782480780.386514:0:5812:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5809:x1869066311631616:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782480780.387518:0:5812:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5809:x1869066311631616:12345-0@lo:1000:mdt00_002.0 Request processed in 1001us (9478us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1782480780.387541:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782480780.390002:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d46048a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5809:1869066311631616:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1782480780.390059:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023ff4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.390070:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023ff4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.390077:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023ff4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.390084:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9e00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480780.390089:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023ff4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.390097:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023ff4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.390114:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d5230fb00) 00010000:00010000:0.0:1782480780.390118:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782480780.390140:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023ff4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.390146:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c023ff4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.390192:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023f29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.390199:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023f29 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.390204:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023f29 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.390209:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ecc00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480780.390212:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023f29 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.390218:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023f29 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.390226:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d4bddcd00) 00010000:00010000:0.0:1782480780.390229:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782480780.390232:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023f29 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.390238:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c023f29 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.391917:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ffb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.391943:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c023f45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8fc expref: 16 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.391965:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ffb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.392008:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c023f45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8fc expref: 16 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.392024:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c023f45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8fc expref: 16 pid: 11544 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480780.392040:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d46049180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1869066311631744:192.168.204.51@tcp:104: 00000100:00100000:0.0:1782480780.392177:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d460dc180 going to sleep for 11 seconds 00000100:00100000:2.0:1782480780.403468:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480780.403958:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d46049180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1869066311631744:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480780.403989:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ffb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480780.408002:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291686016 00000100:00100000:1.0:1782480780.408018:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291686016 00010000:00010000:1.0:1782480780.408074:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c023f45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8fc expref: 17 pid: 11544 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480780.409389:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:1.0:1782480780.409421:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+17:2366:x1869066291686016:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480780.409440:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480780.409449:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c023f45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8fc expref: 17 pid: 11544 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.409464:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c023f45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8fc expref: 17 pid: 11544 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.409487:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c023f45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f8fc expref: 17 pid: 11544 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.409502:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d4bddcd00) 00010000:00010000:1.0:1782480780.409508:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ffb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.409517:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ffb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.409533:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ffb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.409568:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480780.409630:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+16:2366:x1869066291686016:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 215us (6171us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480780.409639:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 46 00010000:00010000:2.0:1782480780.410418:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ffb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.410430:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ffb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.410443:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ffb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.410449:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ffb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.410456:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ffb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.410462:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480780.410467:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ffb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.410474:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ffb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.410485:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d4bddcd00) 00010000:00010000:2.0:1782480780.410488:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480780.410492:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ffb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.410498:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c023ffb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.410538:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023fed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.410544:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023fed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.410551:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023fed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.410556:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480780.410559:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023fed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.410566:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023fed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.410574:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d4bddcd00) 00010000:00010000:2.0:1782480780.410577:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782480780.410580:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023fed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480780.410586:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c023fed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480780.410855:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+15:10442:x1869066291685760:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 66292us (72934us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1782480780.410867:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 83 00000020:00080000:2.0:1782480780.410872:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1782480780.411168:0:11541:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480780.411173:0:11541:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480780.411202:0:11541:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1782480780.411211:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782480780.415552:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480780.415631:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291686272 00000100:00100000:1.0:1782480780.415643:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291686272 00000100:00100000:1.0:1782480780.415709:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:1.0:1782480780.415721:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+15:10442:x1869066291686272:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1782480780.418069:0:5811:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1782480780.418192:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1782480780.418485:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c024002 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.418626:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c024002 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.418640:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c024002 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.418657:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c024002 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.418663:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c024002 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.418668:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c024002 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.418695:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782480780.418808:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480780.418824:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c024002 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.418834:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c000 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480780.418839:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c024002 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.418849:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c024002 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480780.418863:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b6d43255700) 00000100:00100000:0.0:1782480780.418864:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+17:10442:x1869066291686272:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 3141us (3318us total) trans 4294967362 rc 0/0 00010000:00010000:1.0:1782480780.418870:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782480780.418876:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c024002 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480780.418882:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00010000:00010000:1.0:1782480780.418889:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c024002 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782480780.418892:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782480780.418914:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480780.418917:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480780.418919:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782480780.758987:0:11858:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782480780.758997:0:11858:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782480780.759034:0:11858:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782480780.759041:0:11858:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782480780.948589:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480780.948977:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291686528 00000100:00100000:0.0:1782480780.948987:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291686528 00000100:00100000:0.0:1782480780.949051:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:0.0:1782480780.949062:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+17:10452:x1869066291686528:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1782480780.949090:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480780.949114:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d200/0x3dc3ebf33c024009 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f934 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.949379:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c024010 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.949394:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c024010 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.949405:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c024010 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480780.949424:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1782480780.949608:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d200/0x3dc3ebf33c024009 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f934 expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.949625:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c024010 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f934 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.949634:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:0.0:1782480780.949637:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782480780.949641:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2ce00, rc 0) 00000100:00100000:0.0:1782480780.949717:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+19:10452:x1869066291686528:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 656us (1136us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1782480780.949724:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:3.0:1782480780.953338:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480780.954972:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291686656 00000100:00100000:0.0:1782480780.954986:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291686656 00000100:00100000:0.0:1782480780.955042:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:0.0:1782480780.955053:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+19:10452:x1869066291686656:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:0.0:1782480780.955129:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c02401e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955146:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c02401e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955158:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c02401e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955173:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024025 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955193:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955201:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955503:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c02402c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955524:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c02402c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955532:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c02402c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782480780.955572:0:10450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c02402c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955584:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c02401e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955591:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c02401e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955597:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c02401e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955604:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480780.955608:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c02401e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955617:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c02401e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955636:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:0.0:1782480780.955639:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480780.955644:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c02401e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955650:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c02401e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955663:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955669:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024025 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955675:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024025 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955680:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480780.955683:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024025 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955690:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024025 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955697:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d43255300) 00010000:00010000:0.0:1782480780.955699:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480780.955702:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024025 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955708:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024025 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955732:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c02402c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955739:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c02402c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955744:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c02402c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955776:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2dc00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480780.955780:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c02402c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955786:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c02402c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955795:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d43255800) 00010000:00010000:0.0:1782480780.955797:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480780.955800:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c02402c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480780.955806:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c02402c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480780.955899:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+19:10452:x1869066291686656:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 846us (2567us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480780.955908:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 85 00010000:00010000:1.0:1782480780.983403:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480781.011164:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480781.011217:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291686912 00000100:00100000:1.0:1782480781.011226:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291686912 00000100:00100000:1.0:1782480781.011293:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:1.0:1782480781.011304:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+19:10455:x1869066291686912:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1782480781.011324:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480781.011345:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024033 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f93b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.011425:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c02403a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.011440:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c02403a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.011450:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c02403a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.011480:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024041 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.011488:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.011495:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.011811:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c024048 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.011820:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c024048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.011827:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c024048 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480781.011838:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1782480781.011929:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c02403a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.011937:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c02403a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.011950:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c02403a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.011956:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480781.011966:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c02403a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.011972:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c02403a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.011984:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:1.0:1782480781.011988:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480781.011993:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c02403a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.011998:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c02403a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.012008:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.012013:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024041 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.012018:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.012023:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480781.012026:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.012042:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024041 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.012050:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d5230f200) 00010000:00010000:1.0:1782480781.012052:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480781.012055:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024041 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.012060:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024041 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.012097:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024033 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f93b expref: 22 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.012109:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c024048 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f93b expref: 21 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.012115:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:1.0:1782480781.012117:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782480781.012119:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572600, rc 0) 00000100:00100000:1.0:1782480781.012177:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+21:10455:x1869066291686912:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 875us (1022us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1782480781.012185:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00080000:1.0:1782480781.012209:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480781.017494:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480781.017579:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291687040 00000100:00100000:2.0:1782480781.017604:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291687040 00000100:00100000:2.0:1782480781.017671:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:2.0:1782480781.017681:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+21:10455:x1869066291687040:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:2.0:1782480781.017785:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024056 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.017803:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.017814:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.017839:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.017846:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024056 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.017852:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.017858:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480781.017862:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.017869:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024056 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.017880:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:2.0:1782480781.017882:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782480781.017887:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024056 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.017904:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024056 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480781.017971:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+21:10455:x1869066291687040:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 291us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480781.017980:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:1.0:1782480781.020975:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480781.021085:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291687296 00000100:00100000:3.0:1782480781.021094:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291687296 00000100:00100000:3.0:1782480781.021155:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:3.0:1782480781.021165:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45d56c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+21:10455:x1869066291687296:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1782480781.021405:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45d56c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+22:10455:x1869066291687296:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 241us (439us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1782480781.021414:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:1.0:1782480781.047921:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d757c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1869066311632128:0@lo:400:kworker.0 00000100:00100000:1.0:1782480781.047999:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480781.048051:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782480781.048057:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d757c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869066311632000:0@lo:400:kworker.0 00000100:00100000:1.0:1782480781.048080:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480781.048109:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311632128 00000100:00100000:1.0:1782480781.048116:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311632128 00000100:00100000:1.0:1782480781.048163:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311632000 00000100:00100000:1.0:1782480781.048167:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311632000 00000100:00100000:1.0:1782480781.048188:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1782480781.048196:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869066311632128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480781.048247:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869066311632128:12345-0@lo:400:kworker.0 Request processed in 50us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480781.048253:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1782480781.048269:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1782480781.048274:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869066311632000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480781.048300:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1869066311632000:12345-0@lo:400:kworker.0 Request processed in 25us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480781.048306:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1782480781.048320:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480781.048355:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d757c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3318:1869066311632000:0@lo:400:kworker.0 00000100:00100000:1.0:1782480781.048365:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d757c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1869066311632128:0@lo:400:kworker.0 00000100:00100000:0.0:1782480781.048543:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d757c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311631872:0@lo:400:kworker.0 00000100:00100000:0.0:1782480781.048582:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480781.048617:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d757c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066311632384:0@lo:400:kworker.0 00000100:00100000:0.0:1782480781.048641:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480781.048661:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782480781.048667:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d757c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311632256:0@lo:400:kworker.0 00000100:00100000:0.0:1782480781.048692:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480781.048719:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311632384 00000100:00100000:0.0:1782480781.048723:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311632384 00000100:00100000:0.0:1782480781.048784:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1782480781.048792:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066311632384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480781.048834:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066311632384:12345-0@lo:400:kworker.0 Request processed in 43us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480781.048840:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1782480781.048859:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311632256 00000100:00100000:0.0:1782480781.048863:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311632256 00000100:00100000:0.0:1782480781.048888:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782480781.048894:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3316:x1869066311632256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480781.048924:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3316:x1869066311632256:12345-0@lo:400:kworker.0 Request processed in 31us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480781.048930:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782480781.048955:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d757c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311632256:0@lo:400:kworker.0 00000100:00100000:0.0:1782480781.048964:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d757c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066311632384:0@lo:400:kworker.0 00000100:00080000:0.0:1782480781.048981:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782480781.048985:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480781.049229:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311631872 00000100:00100000:1.0:1782480781.049233:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311631872 00000100:00100000:1.0:1782480781.049270:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1782480781.049277:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46a88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3316:x1869066311631872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480781.049311:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46a88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3316:x1869066311631872:12345-0@lo:400:kworker.0 Request processed in 35us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480781.049324:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1782480781.049601:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d757c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311631872:0@lo:400:kworker.0 00000100:00100000:1.0:1782480781.063640:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480781.063730:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291687552 00000100:00100000:2.0:1782480781.063740:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291687552 00000100:00100000:2.0:1782480781.063825:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:2.0:1782480781.063835:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+22:9984:x1869066291687552:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1782480781.063860:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480781.063880:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02405d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f942 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.063982:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024064 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.063996:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c024048 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f93b expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.064005:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024064 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.064035:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c024048 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f93b expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.064047:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c024048 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f93b expref: 23 pid: 5809 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480781.064077:0:5808:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b2bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1869066311632512:192.168.204.51@tcp:104: 00000100:00100000:2.0:1782480781.064166:0:5808:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6c42ca7240 going to sleep for 11 seconds 00000100:00100000:2.0:1782480781.067156:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480781.067256:0:5808:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b2bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1869066311632512:192.168.204.51@tcp:104: 00010000:00010000:1.0:1782480781.067284:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024064 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480781.067350:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291687680 00000100:00100000:3.0:1782480781.067357:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291687680 00010000:00010000:3.0:1782480781.067394:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c024048 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f93b expref: 24 pid: 5809 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480781.067433:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:3.0:1782480781.067441:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+24:2367:x1869066291687680:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480781.067454:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480781.067460:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c024048 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f93b expref: 24 pid: 5809 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.067472:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c024048 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f93b expref: 24 pid: 5809 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.067493:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c024048 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f93b expref: 24 pid: 5809 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.067533:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:3.0:1782480781.067538:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024064 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.067547:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024064 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.067553:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024064 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.067581:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480781.067633:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+23:2367:x1869066291687680:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 191us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480781.067640:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00010000:00010000:1.0:1782480781.067915:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024064 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.067924:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024064 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480781.067943:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1782480781.068101:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02405d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f942 expref: 24 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.068118:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024064 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f942 expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.068125:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:1.0:1782480781.068127:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782480781.068129:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9800, rc 0) 00000100:00100000:1.0:1782480781.068157:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+23:9984:x1869066291687552:12345-192.168.204.51@tcp:101:bash.0 Request processed in 4324us (4528us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1782480781.068165:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:0.0:1782480781.074367:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480781.076869:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291687936 00000100:00100000:0.0:1782480781.076894:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291687936 00000100:00100000:0.0:1782480781.076960:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 89 00000100:00100000:0.0:1782480781.076972:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+23:9984:x1869066291687936:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:0.0:1782480781.077276:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024072 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.077307:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024072 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.077320:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024072 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782480781.077380:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1782480781.077412:0:5809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061c88768 reply state 000000005243240f transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024072 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480781.077422:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1782480781.077482:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1782480781.079046:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+27:9984:x1869066291687936:12345-192.168.204.51@tcp:36:bash.0 Request processed in 2067us (4753us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1782480781.079058:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 89 00000020:00080000:1.0:1782480781.079072:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1782480781.084614:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024072 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.084630:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024072 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.084637:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024072 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.084642:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2dc00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480781.084647:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024072 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.084654:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024072 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.084689:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:0.0:1782480781.084692:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480781.084696:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024072 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.084702:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024072 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480781.084902:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480781.085615:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291688064 00000100:00100000:0.0:1782480781.085626:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291688064 00000100:00100000:0.0:1782480781.085686:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 90 00000100:00100000:0.0:1782480781.085696:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+26:9984:x1869066291688064:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1782480781.085720:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480781.085737:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024079 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f949 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.085864:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024079 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f949 expref: 27 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.085878:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024079 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f949 expref: 27 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.085898:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:0.0:1782480781.085901:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782480781.085904:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2c800, rc 0) 00000100:00100000:2.0:1782480781.086086:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+27:9984:x1869066291688064:12345-192.168.204.51@tcp:101:bash.0 Request processed in 389us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480781.086094:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 90 00000100:00100000:2.0:1782480781.088508:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480781.088616:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291688192 00000100:00100000:0.0:1782480781.088625:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291688192 00000100:00100000:0.0:1782480781.089178:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:0.0:1782480781.089196:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:9984:x1869066291688192:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1782480781.089212:0:6604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480781.089373:0:6604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c024080 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f950 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782480781.089398:0:6604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a3e7f8b, atime: 0x6a3e7f8a, ctime: 0x6a3e7f8b, blocks: 0xb 00010000:00010000:0.0:1782480781.089418:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=401s v=(0 0) 00010000:00010000:0.0:1782480781.089422:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480781.089430:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c024080 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f950 expref: 7 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.089445:0:6604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c024080 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f950 expref: 7 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.089456:0:6604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2d200, rc 0) 00000100:00100000:0.0:1782480781.089526:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+7:9984:x1869066291688192:12345-192.168.204.51@tcp:101:bash.0 Request processed in 316us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480781.089534:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00080000:1.0:1782480781.089907:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782480781.091980:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480781.092321:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291688320 00000100:00100000:2.0:1782480781.092330:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291688320 00002000:00010000:2.0:1782480781.092372:0:6608:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1782480781.092376:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d757c4e00 with x1869066291688320 ext(0->18446744073709551615) 00002000:00010000:2.0:1782480781.092387:0:6608:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d757c4e00. 00000100:00100000:2.0:1782480781.092422:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:2.0:1782480781.092432:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2368:x1869066291688320:12345-192.168.204.51@tcp:10:bash.0 00002000:00010000:2.0:1782480781.092716:0:6608:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1782480781.092720:0:6608:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1782480779 -> 1782480781 00002000:00010000:2.0:1782480781.092722:0:6608:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1782480778 -> 1782480778 00002000:00010000:2.0:1782480781.092724:0:6608:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1782480779 -> 1782480781 00002000:00010000:2.0:1782480781.092727:0:6608:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1782480781.092821:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2368:x1869066291688320:12345-192.168.204.51@tcp:10:bash.0 Request processed in 389us (848us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1782480781.092830:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00002000:00010000:2.0:1782480781.092833:0:6608:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1782480781.092836:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d757c4e00 with x1869066291688320 ext(0->18446744073709551615) 00002000:00010000:2.0:1782480781.092850:0:6608:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d757c4e00. 00000100:00100000:0.0:1782480781.182469:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480781.182586:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291688448 00000100:00100000:1.0:1782480781.182598:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291688448 00000100:00100000:1.0:1782480781.182662:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:1.0:1782480781.182673:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+27:10469:x1869066291688448:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:1.0:1782480781.182791:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024087 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.182808:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024087 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.182820:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024087 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.182837:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c02408e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.182845:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c02408e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.182851:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c02408e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183244:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024095 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183256:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183264:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480781.183307:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183319:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024087 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183326:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024087 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183333:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024087 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183339:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480781.183344:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024087 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183352:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024087 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183363:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:2.0:1782480781.183367:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480781.183372:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024087 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183389:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024087 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183403:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c02408e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183409:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c02408e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183415:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c02408e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183421:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480781.183424:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c02408e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183431:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c02408e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183439:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d5230f200) 00010000:00010000:2.0:1782480781.183442:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480781.183444:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c02408e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183450:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c02408e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183464:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183470:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024095 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183483:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024095 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183488:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480781.183491:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024095 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183497:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024095 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183505:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:2.0:1782480781.183522:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480781.183525:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024095 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.183532:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024095 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480781.183622:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+27:10469:x1869066291688448:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 949us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480781.183632:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:2.0:1782480781.238204:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480781.238362:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291688704 00000100:00100000:1.0:1782480781.238373:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291688704 00000100:00100000:1.0:1782480781.238438:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 92 00000100:00100000:1.0:1782480781.238449:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+27:10472:x1869066291688704:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1782480781.238616:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480781.238637:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c02409c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f957 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.238722:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c0240a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.238737:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c0240a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.238748:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c0240a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.238971:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0240aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.238980:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0240aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.238987:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0240aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.239315:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0240b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.239325:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0240b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.239333:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0240b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480781.239410:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1782480781.239506:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c0240a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.239524:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c0240a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.239531:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c0240a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.239536:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480781.239541:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c0240a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.239548:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c0240a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.239559:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:2.0:1782480781.239562:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480781.239566:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c0240a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.239581:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c0240a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.239594:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0240aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.239599:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0240aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.239605:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0240aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.239609:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480781.239612:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0240aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.239617:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0240aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.239624:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d45d62300) 00010000:00010000:2.0:1782480781.239627:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480781.239629:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0240aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.239635:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0240aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.239676:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c02409c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f957 expref: 30 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.239690:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0240b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f957 expref: 29 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.239704:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:2.0:1782480781.239706:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1782480781.239709:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9200, rc 0) 00000100:00100000:2.0:1782480781.239875:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+29:10472:x1869066291688704:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1427us (1691us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1782480781.239883:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 92 00000100:00100000:2.0:1782480781.243797:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480781.243980:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291688832 00000100:00100000:1.0:1782480781.243990:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291688832 00000100:00100000:1.0:1782480781.244055:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 93 00000100:00100000:1.0:1782480781.244066:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+29:10472:x1869066291688832:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:1.0:1782480781.244145:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0240bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.244162:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024064 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f942 expref: 29 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.244170:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0240bf lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.244205:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024064 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f942 expref: 29 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.244218:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024064 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f942 expref: 29 pid: 5808 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480781.244233:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d757c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1869066311632640:192.168.204.51@tcp:104: 00000100:00100000:1.0:1782480781.245097:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d460dc540 going to sleep for 11 seconds 00000100:00100000:1.0:1782480781.247227:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d757c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1869066311632640:192.168.204.51@tcp:104: 00010000:00010000:1.0:1782480781.247254:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0240bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480781.248408:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480781.248686:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291689088 00000100:00100000:3.0:1782480781.248695:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291689088 00000100:00100000:1.0:1782480781.248933:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:1.0:1782480781.248946:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+30:5581:x1869066291689088:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1782480781.249273:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+31:5581:x1869066291689088:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 328us (868us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1782480781.249282:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:0.0:1782480781.252187:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480781.252327:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291689216 00000100:00100000:3.0:1782480781.252346:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291689216 00010000:00010000:3.0:1782480781.252389:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024064 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f942 expref: 31 pid: 5808 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480781.252434:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:3.0:1782480781.252443:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+31:2367:x1869066291689216:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480781.252460:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480781.252467:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024064 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f942 expref: 31 pid: 5808 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.252493:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024064 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f942 expref: 31 pid: 5808 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.252526:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024064 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f942 expref: 31 pid: 5808 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.252543:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:3.0:1782480781.252549:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0240bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.252558:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0240bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.252566:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0240bf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.252601:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480781.252669:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+30:2367:x1869066291689216:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 218us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480781.252677:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 48 00010000:00010000:2.0:1782480781.253551:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0240bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.253563:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0240bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.253598:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0240bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.253605:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0240bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.253612:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0240bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.253618:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573600 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480781.253622:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0240bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.253628:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0240bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.253655:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:2.0:1782480781.253658:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782480781.253674:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0240bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.253681:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0240bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480781.253922:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+29:10472:x1869066291688832:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 9855us (10185us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480781.253931:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 93 00000100:00100000:0.0:1782480781.258858:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480781.259085:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291689472 00000100:00100000:1.0:1782480781.259094:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291689472 00000100:00100000:1.0:1782480781.259161:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:1.0:1782480781.259170:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+29:10472:x1869066291689472:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1782480781.259411:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+30:10472:x1869066291689472:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 241us (561us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1782480781.259419:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:3.0:1782480781.337868:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480781.338060:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291689728 00000100:00100000:2.0:1782480781.338071:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291689728 00000100:00100000:2.0:1782480781.338141:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00100000:2.0:1782480781.338152:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+30:10483:x1869066291689728:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:2.0:1782480781.338175:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480781.338196:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0240c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f95e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.338266:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0240cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.338278:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0240cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.338498:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0240cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.338529:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0240d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.338558:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0240d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.338565:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0240d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.338926:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0240db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.338936:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0240db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.338944:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0240db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480781.338953:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1782480781.339054:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0240cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.339061:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0240cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.339068:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0240cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.339073:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9600 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480781.339078:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0240cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.339085:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0240cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.339108:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:2.0:1782480781.339111:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480781.339117:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0240cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.339123:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0240cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.339137:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0240d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.339144:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0240d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.339150:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0240d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.339156:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480781.339159:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0240d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.339165:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0240d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.339172:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d45d62300) 00010000:00010000:2.0:1782480781.339174:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480781.339177:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0240d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.339184:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0240d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.339242:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0240c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f95e expref: 33 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.339254:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0240db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f95e expref: 32 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.339262:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:2.0:1782480781.339264:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782480781.339267:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9e00, rc 0) 00000100:00100000:2.0:1782480781.339344:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+32:10483:x1869066291689728:12345-192.168.204.51@tcp:101:cat.0 Request processed in 1193us (1484us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1782480781.339353:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00100000:0.0:1782480781.349011:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480781.349117:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291689984 00000100:00100000:1.0:1782480781.349127:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291689984 00000100:00100000:1.0:1782480781.349185:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:1.0:1782480781.349196:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+32:10483:x1869066291689984:12345-192.168.204.51@tcp:35:cat.0 00000100:00100000:1.0:1782480781.349459:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+33:10483:x1869066291689984:12345-192.168.204.51@tcp:35:cat.0 Request processed in 264us (456us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1782480781.349467:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:0.0:1782480781.377858:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480781.377957:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291690240 00000100:00100000:2.0:1782480781.377966:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291690240 00000100:00100000:2.0:1782480781.378022:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00100000:2.0:1782480781.378032:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+33:10484:x1869066291690240:12345-192.168.204.51@tcp:36:rm.0 00010000:00010000:2.0:1782480781.378090:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782480781.378117:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0240db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f95e expref: 33 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.378137:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0240b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f957 expref: 32 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.378150:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024079 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f949 expref: 31 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.378180:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:2.0:1782480781.378189:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782480781.378209:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0240e9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.378220:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0240e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.378229:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0240e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.378242:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0240f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.378248:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0240f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.378254:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0240f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.378577:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0240f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.378586:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0240f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.378593:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0240f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782480781.379858:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1782480781.379870:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 402221122624ns, next at 403221120164ns, rc = 0 00010000:00010000:2.0:1782480781.380059:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0240fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.380073:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0240fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.380081:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0240fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.380089:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0240fe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.380095:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0240fe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.380100:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0240fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.380191:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782480781.380216:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0240f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.380222:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0240f7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.380229:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0240f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.380235:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8a00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480781.380239:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0240f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.380247:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0240f7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.380266:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d45d62800) 00010000:00010000:2.0:1782480781.380269:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782480781.380273:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0240f7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.380280:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0240f7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.380421:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0240e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.380428:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0240e9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.380434:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0240e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.380439:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480781.380441:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0240e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.380447:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0240e9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.380457:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:2.0:1782480781.380459:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480781.380463:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0240e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.380469:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0240e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480781.380491:0:5809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000066ad09a6 reply state 000000000ba729fb transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0240f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480781.380500:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782480781.380609:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+32:10484:x1869066291690240:12345-192.168.204.51@tcp:36:rm.0 Request processed in 2576us (2757us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1782480781.380619:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 95 00010000:00010000:1.0:1782480781.382305:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480781.382330:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0240fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.382339:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8800 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480781.382342:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0240fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.382351:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0240fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.382365:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b6d45d62800) 00010000:00010000:1.0:1782480781.382368:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782480781.382372:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0240fe lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.382378:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0240fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.382399:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480781.382401:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480781.382403:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480781.387125:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0240f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.387142:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0240f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.387150:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0240f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.387175:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9600 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480781.387179:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0240f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.387186:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0240f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.387203:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d45d62300) 00010000:00010000:3.0:1782480781.387206:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480781.387210:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0240f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.387227:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0240f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480781.417976:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480781.418088:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291690496 00000100:00100000:2.0:1782480781.418097:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291690496 00000100:00100000:2.0:1782480781.418215:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00100000:2.0:1782480781.418227:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+31:10490:x1869066291690496:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1782480781.418252:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480781.418274:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024105 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f965 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.418403:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02410c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.418418:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02410c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.418428:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02410c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.418442:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024113 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.418450:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.418474:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782480781.419077:0:5807:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1782480781.419232:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c02411a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.419244:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c02411a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.419254:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c02411a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.419287:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02410c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.419295:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02410c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.419301:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02410c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.419308:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8a00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480781.419312:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02410c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.419319:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02410c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.419330:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:2.0:1782480781.419333:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480781.419344:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02410c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.419350:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02410c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480781.419364:0:5807:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000089c0190c reply state 00000000dd2dcbd7 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480781.419373:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782480781.419400:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024105 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f965 expref: 34 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.419414:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c02411a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f965 expref: 33 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.419422:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:2.0:1782480781.419424:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782480781.419427:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9e00, rc 0) 00000100:00100000:2.0:1782480781.419501:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+34:10490:x1869066291690496:12345-192.168.204.51@tcp:101:bash.0 Request processed in 1276us (1535us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1782480781.419520:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00100000:2.0:1782480781.423205:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00010000:00010000:0.0:1782480781.423227:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.423257:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024113 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.423264:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.423270:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480781.423275:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.423282:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024113 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480781.423292:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291690624 00000100:00100000:3.0:1782480781.423302:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291690624 00010000:00010000:0.0:1782480781.423307:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d45d62500) 00010000:00010000:0.0:1782480781.423310:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480781.423315:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024113 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.423321:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024113 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480781.423367:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00080000:1.0:1782480781.423415:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480781.423451:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2367:x1869066291690624:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1782480781.423469:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480781.423487:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ee73737/0x3dc3ebf33c024128 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f96c expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782480781.423522:0:8678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782480781.423540:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=402s v=(0 0) 00010000:00010000:3.0:1782480781.423544:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480781.423553:0:8678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ee73737/0x3dc3ebf33c024128 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f96c expref: 8 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.423584:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006ee73737/0x3dc3ebf33c024128 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f96c expref: 8 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.423596:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ec800, rc 0) 00000100:00100000:3.0:1782480781.423648:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2367:x1869066291690624:12345-192.168.204.51@tcp:101:bash.0 Request processed in 272us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480781.423654:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:2.0:1782480781.427324:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480781.427422:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291690752 00000100:00100000:1.0:1782480781.427432:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291690752 00000100:00100000:1.0:1782480781.427490:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:1.0:1782480781.427499:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+8:10490:x1869066291690752:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1782480781.427529:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480781.427548:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d5cb2f0/0x3dc3ebf33c02412f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f973 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.427580:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006ee73737/0x3dc3ebf33c024128 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f96c expref: 9 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.427603:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480781.427607:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480781.427613:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d5cb2f0/0x3dc3ebf33c02412f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f973 expref: 9 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.427646:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006ee73737/0x3dc3ebf33c024128 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f96c expref: 9 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.427727:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006ee73737/0x3dc3ebf33c024128 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f96c expref: 9 pid: 8678 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480781.427743:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d757c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6605:1869066311632768:192.168.204.51@tcp:104: 00000100:00100000:1.0:1782480781.428055:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d460dc540 going to sleep for 11 seconds 00000040:00080000:0.0:1782480781.431006:0:11541:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480781.431014:0:11541:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480781.431173:0:11541:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1782480781.431181:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782480781.431819:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d757c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6605:1869066311632768:192.168.204.51@tcp:104: 00010000:00010000:1.0:1782480781.431851:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005d5cb2f0/0x3dc3ebf33c02412f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f973 expref: 9 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.431871:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573e00, rc 0) 00000100:00100000:1.0:1782480781.431932:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+9:10490:x1869066291690752:12345-192.168.204.51@tcp:101:bash.0 Request processed in 4433us (4616us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480781.431940:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:2.0:1782480781.434275:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480781.434376:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291690880 00000100:00100000:3.0:1782480781.434386:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291690880 00010000:00010000:3.0:1782480781.434425:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006ee73737/0x3dc3ebf33c024128 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f96c expref: 9 pid: 8678 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480781.434492:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:3.0:1782480781.434502:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d465fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+9:2366:x1869066291690880:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480781.434527:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480781.434552:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006ee73737/0x3dc3ebf33c024128 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f96c expref: 9 pid: 8678 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.434567:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006ee73737/0x3dc3ebf33c024128 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f96c expref: 9 pid: 8678 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.434591:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ee73737/0x3dc3ebf33c024128 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f96c expref: 9 pid: 8678 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.434627:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480781.434631:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480781.434639:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d5cb2f0/0x3dc3ebf33c02412f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f973 expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.434649:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d5cb2f0/0x3dc3ebf33c02412f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f973 expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.434688:0:5792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005d5cb2f0/0x3dc3ebf33c02412f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f973 expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480781.434703:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ae96680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5792:1869066311632896:192.168.204.51@tcp:105: 00000100:00100000:0.0:1782480781.435114:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75626300 going to sleep for 11 seconds 00000100:00100000:2.0:1782480781.437814:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480781.437923:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ae96680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5792:1869066311632896:192.168.204.51@tcp:105: 00010000:00010000:0.0:1782480781.437948:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480781.437999:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d465fc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2366:x1869066291690880:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 3498us (3732us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480781.438021:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:1.0:1782480781.438539:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291691136 00000100:00100000:1.0:1782480781.438549:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291691136 00000100:00100000:1.0:1782480781.438599:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:1.0:1782480781.438615:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+33:10490:x1869066291691136:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:1.0:1782480781.439137:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+34:10490:x1869066291691136:12345-192.168.204.51@tcp:35:bash.0 Request processed in 522us (1329us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1782480781.439144:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:3.0:1782480781.555036:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480781.555419:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291691264 00000100:00100000:2.0:1782480781.555429:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291691264 00000100:00100000:2.0:1782480781.555498:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 97 00000100:00100000:2.0:1782480781.555518:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+34:10506:x1869066291691264:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1782480781.555562:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480781.555581:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024136 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f97a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.555654:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02413d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.555670:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02413d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.555681:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02413d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480781.555743:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1782480781.555884:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480781.555914:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02413d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.555942:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024136 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f97a expref: 36 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.555961:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02413d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f97a expref: 35 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.555970:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:2.0:1782480781.555973:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782480781.555977:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e8a00, rc 0) 00000100:00100000:2.0:1782480781.556044:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+35:10506:x1869066291691264:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 527us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480781.556051:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 97 00000100:00100000:3.0:1782480781.559248:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b2bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311633024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480781.559318:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480781.559383:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311633024 00000100:00100000:0.0:1782480781.559392:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311633024 00000100:00100000:0.0:1782480781.559441:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782480781.559450:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1869066311633024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782480781.559486:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480781.559549:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1869066311633024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480781.559556:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782480781.559608:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b2bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311633024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480781.560012:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480781.560170:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291691520 00000100:00100000:0.0:1782480781.560176:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291691520 00000100:00100000:0.0:1782480781.560252:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 98 00000100:00100000:0.0:1782480781.560260:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+35:10506:x1869066291691520:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1782480781.560273:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480781.560303:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024144 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f981 expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.560422:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c02414b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.560436:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c02414b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.560448:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c02414b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480781.560459:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1782480781.560602:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024144 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f981 expref: 38 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.560634:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c02414b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f981 expref: 37 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.560643:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:0.0:1782480781.560647:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782480781.560650:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2d400, rc 0) 00000100:00100000:0.0:1782480781.560704:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+37:10506:x1869066291691520:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 445us (694us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1782480781.560712:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 98 00000100:00100000:0.0:1782480781.564288:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480781.564372:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480781.564441:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291691904 00000100:00100000:2.0:1782480781.564450:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291691904 00000100:00100000:2.0:1782480781.564521:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 99 00000100:00100000:2.0:1782480781.564531:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+37:10506:x1869066291691904:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1782480781.564556:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480781.564575:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024159 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f988 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.564685:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024160 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.564701:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.564712:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480781.564726:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1782480781.565053:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024159 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f988 expref: 40 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.565072:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024160 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f988 expref: 39 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.565081:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:2.0:1782480781.565084:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782480781.565087:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9200, rc 0) 00000100:00100000:2.0:1782480781.565155:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+39:10506:x1869066291691904:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 625us (782us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1782480781.565179:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 99 00000100:00100000:3.0:1782480781.566222:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291691648 00000100:00100000:3.0:1782480781.566231:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291691648 00000100:00100000:3.0:1782480781.566328:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:3.0:1782480781.566338:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+39:2366:x1869066291691648:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480781.566350:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480781.566368:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c02414b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f981 expref: 39 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.566396:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:3.0:1782480781.566400:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480781.566446:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+38:2366:x1869066291691648:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 109us (2167us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480781.566453:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:0.0:1782480781.575630:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480781.575773:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291692032 00000100:00100000:1.0:1782480781.575783:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291692032 00000100:00100000:1.0:1782480781.575849:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:1.0:1782480781.575859:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2367:x1869066291692032:12345-192.168.204.51@tcp:1:lfs.0 00010000:00010000:1.0:1782480781.576556:0:6602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fa3ff96/0x3dc3ebf33c02416e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.576581:0:6602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d5cb2f0/0x3dc3ebf33c02412f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f973 expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.576590:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480781.576594:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782480781.576599:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fa3ff96/0x3dc3ebf33c02416e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.576636:0:6602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d5cb2f0/0x3dc3ebf33c02412f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f973 expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.576652:0:6602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d5cb2f0/0x3dc3ebf33c02412f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f973 expref: 8 pid: 6605 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480781.576669:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d757c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6602:1869066311633152:192.168.204.51@tcp:104: 00000100:00100000:1.0:1782480781.576842:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d487f6600 going to sleep for 11 seconds 00000100:00100000:1.0:1782480781.581280:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d757c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6602:1869066311633152:192.168.204.51@tcp:104: 00010000:00010000:1.0:1782480781.581312:0:6602:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000fa3ff96/0x3dc3ebf33c02416e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480781.584696:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480781.584824:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291692160 00000100:00100000:2.0:1782480781.584835:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291692160 00002000:00100000:2.0:1782480781.584886:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9b6d755d9180 x1869066291692160/t0(0) o4->49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp:537/0 lens 504/0 e 0 to 0 dl 1782480792 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782480781.584898:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d755d9180 with x1869066291692160 ext(0->8) 00010000:00010000:2.0:1782480781.584908:0:6610:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005d5cb2f0/0x3dc3ebf33c02412f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f973 expref: 9 pid: 6605 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.584925:0:6610:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005d5cb2f0/0x3dc3ebf33c02412f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f973 expref: 9 pid: 6605 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782480781.584932:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b6d755d9180 00000100:00100000:2.0:1782480781.585026:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:2.0:1782480781.585036:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+9:2367:x1869066291692160:12345-192.168.204.51@tcp:4:lfs.0 00000100:00100000:2.0:1782480781.585563:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+11:2367:x1869066291692160:12345-192.168.204.51@tcp:4:lfs.0 Request processed in 525us (874us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1782480781.585571:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00002000:00100000:2.0:1782480781.585579:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9b6d755d9180 x1869066291692160/t4294967302(0) o4->49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp:537/0 lens 504/448 e 0 to 0 dl 1782480792 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782480781.585588:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d755d9180 with x1869066291692160 ext(0->8) 00010000:00010000:2.0:1782480781.585594:0:6610:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005d5cb2f0/0x3dc3ebf33c02412f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f973 expref: 11 pid: 6605 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.585618:0:6610:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005d5cb2f0/0x3dc3ebf33c02412f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f973 expref: 11 pid: 6605 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782480781.585625:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b6d755d9180 00000100:00100000:0.0:1782480781.588251:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480781.588410:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291692288 00000100:00100000:2.0:1782480781.588420:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291692288 00010000:00010000:2.0:1782480781.588460:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d5cb2f0/0x3dc3ebf33c02412f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f973 expref: 11 pid: 6605 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480781.588792:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:2.0:1782480781.588805:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+11:2366:x1869066291692288:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480781.588819:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1782480781.588838:0:5793:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1782480781.588841:0:5793:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782480781 00002000:00010000:2.0:1782480781.588843:0:5793:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1782480782 00002000:00010000:2.0:1782480781.588846:0:5793:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1782480781 00010000:00010000:2.0:1782480781.588852:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d5cb2f0/0x3dc3ebf33c02412f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f973 expref: 11 pid: 6605 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.588867:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d5cb2f0/0x3dc3ebf33c02412f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f973 expref: 11 pid: 6605 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.588905:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d5cb2f0/0x3dc3ebf33c02412f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f973 expref: 11 pid: 6605 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.588947:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782480781.588951:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782480781.588957:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000fa3ff96/0x3dc3ebf33c02416e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.588967:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fa3ff96/0x3dc3ebf33c02416e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.588991:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480781.589498:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+10:2366:x1869066291692288:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 685us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480781.589518:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 50 00010000:00010000:1.0:1782480781.590667:0:6602:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000fa3ff96/0x3dc3ebf33c02416e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.590683:0:6602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fa3ff96/0x3dc3ebf33c02416e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.590718:0:6602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fa3ff96/0x3dc3ebf33c02416e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.590726:0:6602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fa3ff96/0x3dc3ebf33c02416e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.590735:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fa3ff96/0x3dc3ebf33c02416e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.590742:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572000 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480781.590780:0:6602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fa3ff96/0x3dc3ebf33c02416e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.590789:0:6602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fa3ff96/0x3dc3ebf33c02416e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.590822:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fa3ff96/0x3dc3ebf33c02416e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.590830:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fa3ff96/0x3dc3ebf33c02416e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480781.590913:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+9:2367:x1869066291692032:12345-192.168.204.51@tcp:1:lfs.0 Request processed in 15052us (15290us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480781.590921:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:0.0:1782480781.595858:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480781.595957:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291692544 00000100:00100000:3.0:1782480781.595967:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291692544 00000100:00100000:3.0:1782480781.596028:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:3.0:1782480781.596037:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45d57c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+38:10506:x1869066291692544:12345-192.168.204.51@tcp:35:lfs.0 00000004:00010000:3.0:1782480781.596104:0:5810:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024160 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f988 expref: 38 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782480781.596471:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1782480781.596535:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1782480781.597113:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1782480781.597173:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024175 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.597189:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c02411a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f965 expref: 42 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.597199:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024175 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.597296:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c02411a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f965 expref: 42 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.597330:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c02411a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f965 expref: 42 pid: 5807 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480781.597345:0:5810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ae94380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5810:1869066311633280:192.168.204.51@tcp:104: 00000100:00100000:3.0:1782480781.597497:0:5810:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75626f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782480781.601589:0:5810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ae94380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5810:1869066311633280:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480781.601634:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024175 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480781.602121:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480781.603631:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291692672 00000100:00100000:1.0:1782480781.603645:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291692672 00010000:00010000:1.0:1782480781.603698:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c02411a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f965 expref: 43 pid: 5807 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480781.603788:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:1.0:1782480781.603800:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+43:2366:x1869066291692672:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480781.603816:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480781.603825:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c02411a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f965 expref: 43 pid: 5807 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.603838:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c02411a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f965 expref: 43 pid: 5807 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.603859:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c02411a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f965 expref: 43 pid: 5807 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.603895:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:1.0:1782480781.603900:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024175 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.603911:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024175 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.603918:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024175 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.603939:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480781.604011:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+42:2366:x1869066291692672:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 213us (1891us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480781.604019:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00010000:00010000:0.0:1782480781.604289:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024175 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.604298:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024175 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782480781.604449:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1782480781.604686:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1782480781.605335:0:5810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1869066311633408:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782480781.605389:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480781.605423:0:5810:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45265d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782480781.605548:0:5813:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311633408 00000100:00100000:2.0:1782480781.605555:0:5813:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311633408 00000100:00100000:2.0:1782480781.605610:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782480781.605619:0:5813:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5810:x1869066311633408:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782480781.605701:0:5813:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5810:x1869066311633408:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 83us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480781.605709:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782480781.606050:0:5810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1869066311633408:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1782480781.606517:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1782480781.606584:0:5810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1869066311633536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782480781.606618:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480781.606706:0:5810:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d53c07e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782480781.607125:0:5813:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311633536 00000100:00100000:2.0:1782480781.607131:0:5813:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311633536 00000100:00100000:2.0:1782480781.607174:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782480781.607181:0:5813:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5810:x1869066311633536:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1782480781.607521:0:5813:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5810:x1869066311633536:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 339us (901us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1782480781.607538:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782480781.607560:0:5810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1869066311633536:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1782480781.607611:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1782480781.607668:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024175 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.607679:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024175 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.607686:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024175 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.607692:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ec000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480781.607696:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024175 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.607704:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024175 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.607721:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:0.0:1782480781.607724:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1782480781.607736:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024175 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.607742:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024175 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782480781.608096:0:5810:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1782480781.608167:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1782480781.608175:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 402449427475ns, next at 403449426203ns, rc = 0 00000001:00080000:0.0:1782480781.608179:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1782480781.608203:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:0.0:1782480781.608205:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782480781.608211:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024160 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f988 expref: 46 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480781.608338:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45d57c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+45:10506:x1869066291692544:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 12301us (12489us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1782480781.608347:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 26 00000020:00080000:0.0:1782480781.608351:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1782480781.612600:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480781.612701:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291692800 00000100:00100000:1.0:1782480781.612711:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291692800 00000100:00100000:1.0:1782480781.613091:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 100 00000100:00100000:1.0:1782480781.613105:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+45:10506:x1869066291692800:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1782480781.613129:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480781.613153:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c02417c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f98f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.613226:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c02417c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f98f expref: 46 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.613243:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c02417c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f98f expref: 46 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.613286:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:1.0:1782480781.613290:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782480781.613293:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572000, rc 0) 00000100:00100000:1.0:1782480781.613358:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+46:10506:x1869066291692800:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 256us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480781.613366:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 100 00000100:00100000:3.0:1782480781.619453:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480781.619693:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291693056 00000100:00100000:1.0:1782480781.619704:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291693056 00000100:00100000:1.0:1782480781.619808:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:1.0:1782480781.619819:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+46:10506:x1869066291693056:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1782480781.620065:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+47:10506:x1869066291693056:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 247us (623us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1782480781.620074:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:0.0:1782480781.691518:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480781.691640:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291693184 00000100:00100000:1.0:1782480781.691650:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291693184 00000100:00100000:1.0:1782480781.691711:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 101 00000100:00100000:1.0:1782480781.691720:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+47:10516:x1869066291693184:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:1.0:1782480781.691822:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024183 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.691840:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024183 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.691851:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024183 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.691884:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c02418a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.691892:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c02418a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.691899:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c02418a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.691997:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024191 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692005:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692012:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782480781.692072:0:10450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692084:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024183 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692090:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024183 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692101:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024183 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692108:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573a00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480781.692113:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024183 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692128:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024183 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692142:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:1.0:1782480781.692145:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480781.692150:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024183 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692157:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024183 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692170:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c02418a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692177:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c02418a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692183:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c02418a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692188:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480781.692191:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c02418a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692197:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c02418a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692204:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d5230ff00) 00010000:00010000:1.0:1782480781.692206:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480781.692209:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c02418a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692225:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c02418a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692239:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692244:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024191 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692249:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024191 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692253:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572c00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480781.692255:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024191 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692261:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024191 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692268:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:1.0:1782480781.692270:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480781.692273:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024191 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.692278:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024191 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480781.692509:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+47:10516:x1869066291693184:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 778us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480781.692519:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 101 00000100:00100000:3.0:1782480781.739001:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480781.739740:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291693440 00000100:00100000:2.0:1782480781.739848:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291693440 00000100:00100000:2.0:1782480781.739921:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 102 00000100:00100000:2.0:1782480781.739932:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+47:10520:x1869066291693440:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1782480781.740161:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480781.740255:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024198 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f996 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.740460:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02419f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.743267:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02419f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.743814:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02419f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.743849:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0241a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.743861:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0241a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.743869:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0241a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.744510:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0241ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.744542:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0241ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.744550:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0241ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480781.744563:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1782480781.744669:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02419f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.744678:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02419f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.744685:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02419f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.744691:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480781.744696:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02419f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.744703:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02419f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.744717:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:2.0:1782480781.744720:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480781.744725:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02419f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.744731:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02419f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.745454:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0241a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.745476:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0241a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.745483:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0241a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.745488:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9600 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480781.745491:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0241a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.745509:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0241a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.745519:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d45d62b00) 00010000:00010000:2.0:1782480781.745522:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480781.745525:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0241a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.745531:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c0241a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.745587:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024198 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f996 expref: 50 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.745602:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0241ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f996 expref: 49 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.745609:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:2.0:1782480781.745611:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782480781.745621:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e8800, rc 0) 00000100:00100000:2.0:1782480781.745790:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+49:10520:x1869066291693440:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 5858us (6840us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1782480781.745800:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 102 00000100:00100000:3.0:1782480781.749698:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480781.750246:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291693568 00000100:00100000:1.0:1782480781.750256:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291693568 00000100:00100000:1.0:1782480781.751055:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 103 00000100:00100000:1.0:1782480781.751069:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+49:10520:x1869066291693568:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:1.0:1782480781.751139:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c0241bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.751156:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c0241bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.751169:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c0241bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.751210:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c0241bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.751218:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c0241bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.751227:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c0241bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.751233:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572c00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480781.751237:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c0241bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.751245:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c0241bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.751257:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:1.0:1782480781.751261:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782480781.751265:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c0241bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.751415:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c0241bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480781.751496:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+49:10520:x1869066291693568:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 430us (1806us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480781.751513:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 103 00000100:00100000:0.0:1782480781.755622:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480781.755802:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291693824 00000100:00100000:1.0:1782480781.755812:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291693824 00000100:00100000:1.0:1782480781.755909:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:1.0:1782480781.755919:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+49:10520:x1869066291693824:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1782480781.756180:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+50:10520:x1869066291693824:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 254us (558us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1782480781.756188:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:3.0:1782480781.830160:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480781.830302:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291694080 00000100:00100000:1.0:1782480781.830312:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291694080 00000100:00100000:1.0:1782480781.830428:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 104 00000100:00100000:1.0:1782480781.830440:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+50:10530:x1869066291694080:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1782480781.830466:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480781.830469:0:10450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782480781.830511:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02413d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f97a expref: 50 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.830531:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:1.0:1782480781.830544:0:10450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782480781.830567:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c0241c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f99d expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.830713:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0241c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.830727:0:10450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0241ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f996 expref: 50 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.830736:0:10450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0241c9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.830829:0:10450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0241ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f996 expref: 50 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.830853:0:10450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0241ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f996 expref: 50 pid: 5807 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480781.830867:0:10450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d757c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10450:1869066311633664:192.168.204.51@tcp:104: 00000100:00100000:1.0:1782480781.830961:0:10450:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d460dcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1782480781.834575:0:10450:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d757c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10450:1869066311633664:192.168.204.51@tcp:104: 00010000:00010000:1.0:1782480781.834607:0:10450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0241c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480781.835701:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480781.835945:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291694208 00000100:00100000:0.0:1782480781.835953:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291694208 00010000:00010000:0.0:1782480781.835993:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0241ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f996 expref: 51 pid: 5807 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480781.836037:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:0.0:1782480781.836048:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+51:2366:x1869066291694208:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480781.836080:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480781.836088:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0241ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f996 expref: 51 pid: 5807 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.836101:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0241ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f996 expref: 51 pid: 5807 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.836122:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0241ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f996 expref: 51 pid: 5807 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.836870:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:0.0:1782480781.836880:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0241c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.836892:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0241c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.836901:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0241c9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.836939:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782480781.836987:0:10450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0241c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.836998:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0241c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480781.837031:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1782480781.837198:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c0241c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f99d expref: 52 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.837219:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0241c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f99d expref: 51 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480781.837219:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+51:2366:x1869066291694208:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 1105us (1457us total) trans 0 rc 0/0 00010000:00010000:1.0:1782480781.837237:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:1.0:1782480781.837242:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:0.0:1782480781.837242:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00010000:00010000:1.0:1782480781.837247:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573800, rc 0) 00000100:00100000:1.0:1782480781.837284:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+50:10530:x1869066291694080:12345-192.168.204.51@tcp:101:bash.0 Request processed in 6847us (7133us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1782480781.837292:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 104 00000100:00100000:3.0:1782480781.841515:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480781.841679:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291694464 00000100:00100000:2.0:1782480781.841689:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291694464 00000100:00100000:2.0:1782480781.841832:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 105 00000100:00100000:2.0:1782480781.841844:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+50:10530:x1869066291694464:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:2.0:1782480781.842111:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0241d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.842128:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0241d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.842139:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0241d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782480781.842190:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1782480781.842214:0:5807:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dc1c3705 reply state 00000000929c7fc9 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0241d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480781.842223:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782480781.842324:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+53:10530:x1869066291694464:12345-192.168.204.51@tcp:36:bash.0 Request processed in 482us (830us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1782480781.842332:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 105 00000020:00080000:2.0:1782480781.842337:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782480781.844028:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0241d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.844042:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0241d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.844049:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0241d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.844055:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480781.844060:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0241d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.844067:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0241d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.844082:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:1.0:1782480781.844084:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480781.844102:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0241d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.844108:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0241d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480781.846881:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480781.846933:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291694592 00000100:00100000:1.0:1782480781.847000:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291694592 00000100:00100000:1.0:1782480781.847066:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 106 00000100:00100000:1.0:1782480781.847076:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+52:10530:x1869066291694592:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1782480781.847100:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480781.847121:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c0241de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f9a4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.847233:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0241e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.847247:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0241c9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f99d expref: 53 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.847256:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0241e5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.847290:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0241c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f99d expref: 53 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.847304:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0241c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f99d expref: 53 pid: 10450 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480781.847318:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d757c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1869066311633792:192.168.204.51@tcp:104: 00000100:00100000:1.0:1782480781.847423:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45265300 going to sleep for 11 seconds 00000100:00100000:1.0:1782480781.850636:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d757c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1869066311633792:192.168.204.51@tcp:104: 00010000:00010000:1.0:1782480781.850667:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0241e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480781.851959:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480781.852109:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291694720 00000100:00100000:1.0:1782480781.852117:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291694720 00010000:00010000:1.0:1782480781.852156:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0241c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f99d expref: 54 pid: 10450 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480781.852191:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:1.0:1782480781.852200:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+54:2366:x1869066291694720:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480781.852213:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480781.852220:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0241c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f99d expref: 54 pid: 10450 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.852232:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0241c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f99d expref: 54 pid: 10450 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.852253:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0241c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f99d expref: 54 pid: 10450 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.852268:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:1.0:1782480781.852272:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0241e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.852282:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0241e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.852301:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0241e5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.852401:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480781.852466:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+53:2366:x1869066291694720:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 266us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480781.852476:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00010000:00010000:2.0:1782480781.856454:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0241e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.856473:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0241e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480781.856569:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1782480781.856573:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480781.856595:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0241e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.856636:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c0241de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9a4 expref: 53 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.856658:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0241e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9a4 expref: 52 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.856667:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:2.0:1782480781.856671:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782480781.856674:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573a00, rc 0) 00000100:00100000:2.0:1782480781.856780:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+52:10530:x1869066291694592:12345-192.168.204.51@tcp:101:bash.0 Request processed in 9703us (9905us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480781.856790:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 106 00000100:00100000:0.0:1782480781.860362:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480781.860460:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291694976 00000100:00100000:3.0:1782480781.860470:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291694976 00000100:00100000:3.0:1782480781.860578:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:3.0:1782480781.860589:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+52:10530:x1869066291694976:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:3.0:1782480781.860846:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+53:10530:x1869066291694976:12345-192.168.204.51@tcp:35:bash.0 Request processed in 258us (489us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1782480781.860854:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:3.0:1782480781.913517:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480781.913733:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291695104 00000100:00100000:1.0:1782480781.913765:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291695104 00000100:00100000:1.0:1782480781.913869:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 107 00000100:00100000:1.0:1782480781.913880:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+53:10536:x1869066291695104:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1782480781.913904:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480781.913924:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0241ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f9ab expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.913981:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c0241f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.913994:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c0241f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.914005:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c0241f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480781.914061:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1782480781.914065:0:10450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782480781.914087:0:10450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c0241f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.914130:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0241ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9ab expref: 55 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.914147:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c0241f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9ab expref: 54 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.914155:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:1.0:1782480781.914158:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782480781.914162:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572c00, rc 0) 00000100:00100000:1.0:1782480781.914288:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+54:10536:x1869066291695104:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 409us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480781.914296:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 107 00000100:00100000:0.0:1782480781.919276:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480781.919368:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291695232 00000100:00100000:2.0:1782480781.919376:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291695232 00000100:00100000:2.0:1782480781.919439:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 108 00000100:00100000:2.0:1782480781.919449:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+54:10536:x1869066291695232:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1782480781.919469:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480781.919488:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0241fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f9b2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919570:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024201 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919603:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024201 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919615:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024201 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919629:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024208 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919637:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919644:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919732:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c02420f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919741:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c02420f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919787:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c02420f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480781.919822:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1782480781.919826:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480781.919843:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c02420f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919855:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c02420f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919874:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024201 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919884:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024201 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919891:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024201 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919897:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480781.919901:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024201 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919909:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024201 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919922:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:2.0:1782480781.919925:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480781.919930:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024201 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919937:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024201 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919949:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919956:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024208 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919962:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024208 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919973:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480781.919977:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024208 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919984:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024208 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.919992:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d45d62b00) 00010000:00010000:2.0:1782480781.919994:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480781.919997:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024208 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.920003:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024208 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.920031:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0241fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9b2 expref: 56 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.920043:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c02420f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9b2 expref: 55 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.920051:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:2.0:1782480781.920054:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782480781.920056:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9600, rc 0) 00000100:00100000:2.0:1782480781.920112:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+55:10536:x1869066291695232:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 664us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480781.920120:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 108 00000100:00100000:3.0:1782480781.927112:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480781.927618:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480781.927768:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291695360 00000100:00100000:0.0:1782480781.927778:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291695360 00000100:00100000:0.0:1782480781.927836:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:0.0:1782480781.927860:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75578700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+55:2367:x1869066291695360:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480781.927876:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480781.927899:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c02420f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9b2 expref: 55 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480781.927919:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:0.0:1782480781.927924:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480781.927970:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75578700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+54:2367:x1869066291695360:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 113us (3222us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480781.927978:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:1.0:1782480781.928709:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291695616 00000100:00100000:1.0:1782480781.928716:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291695616 00000100:00100000:1.0:1782480781.928787:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 109 00000100:00100000:1.0:1782480781.928796:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+54:10536:x1869066291695616:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1782480781.928811:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480781.928827:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c024216 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f9b9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.928917:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02421d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.928930:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0241e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9a4 expref: 55 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.928940:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02421d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.928979:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0241e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9a4 expref: 55 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.928992:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0241e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9a4 expref: 55 pid: 5809 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480781.929006:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d757c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1869066311633920:192.168.204.51@tcp:104: 00000100:00100000:1.0:1782480781.929071:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45265300 going to sleep for 11 seconds 00000100:00100000:1.0:1782480781.931192:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d757c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1869066311633920:192.168.204.51@tcp:104: 00010000:00010000:1.0:1782480781.931218:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02421d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480781.932063:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480781.932227:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291695744 00000100:00100000:3.0:1782480781.932234:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291695744 00010000:00010000:3.0:1782480781.932283:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0241e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9a4 expref: 56 pid: 5809 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480781.932361:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:3.0:1782480781.932372:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d465ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+56:2366:x1869066291695744:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480781.932385:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480781.932391:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0241e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9a4 expref: 56 pid: 5809 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.932403:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0241e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9a4 expref: 56 pid: 5809 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.932422:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0241e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9a4 expref: 56 pid: 5809 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.932437:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:3.0:1782480781.932441:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02421d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.932449:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02421d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.932456:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02421d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480781.932503:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480781.932672:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d465ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+55:2366:x1869066291695744:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 301us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480781.932680:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 54 00010000:00010000:2.0:1782480781.934069:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02421d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.934092:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02421d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480781.934113:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1782480781.934269:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c024216 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9b9 expref: 56 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.934287:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02421d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9b9 expref: 55 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.934296:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:2.0:1782480781.934299:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782480781.934302:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573e00, rc 0) 00000100:00100000:2.0:1782480781.934364:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+55:10536:x1869066291695616:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 5569us (6747us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1782480781.934371:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 109 00000100:00100000:0.0:1782480781.938122:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480781.938190:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291696000 00000100:00100000:2.0:1782480781.938199:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291696000 00000100:00100000:2.0:1782480781.938265:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:2.0:1782480781.938276:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+55:10536:x1869066291696000:12345-192.168.204.51@tcp:103:lfs.0 00010000:00010000:2.0:1782480781.938292:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480781.938315:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c02417c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f98f expref: 55 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480781.938334:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:2.0:1782480781.938338:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480781.938405:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+54:10536:x1869066291696000:12345-192.168.204.51@tcp:103:lfs.0 Request processed in 131us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480781.938413:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:2.0:1782480781.941086:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480781.941181:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291696128 00000100:00100000:1.0:1782480781.941189:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291696128 00000100:00100000:1.0:1782480781.941250:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 110 00000100:00100000:1.0:1782480781.941260:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+54:10536:x1869066291696128:12345-192.168.204.51@tcp:58:lfs.0 00010000:00010000:1.0:1782480781.941374:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02422b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.941390:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02422b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.941403:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02422b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782480781.941613:0:10450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1782480781.941688:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+54:10536:x1869066291696128:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 429us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480781.941715:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 110 00000100:00100000:3.0:1782480781.947424:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480781.948389:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291696256 00000100:00100000:1.0:1782480781.948401:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291696256 00000100:00100000:1.0:1782480781.948464:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 111 00000100:00100000:1.0:1782480781.948473:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+54:10536:x1869066291696256:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1782480781.948501:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480781.948520:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c024232 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f9c0 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.948586:0:11544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02422b lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.948599:0:11544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c024232 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9c0 expref: 55 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.948618:0:11544:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02422b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.948632:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c024232 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9c0 expref: 55 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.948655:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:1.0:1782480781.948658:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782480781.948662:0:11544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c024232 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9c0 expref: 55 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480781.948670:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573c00, rc 0) 00000100:00100000:1.0:1782480781.948849:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+55:10536:x1869066291696256:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 376us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480781.948856:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 111 00010000:00010000:1.0:1782480782.007364:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782480782.454998:0:11541:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480782.455007:0:11541:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480782.455062:0:11541:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1782480782.455083:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782480782.455212:0:11541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11541:1869066311634048:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782480782.455317:0:11541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d53de2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782480782.462886:0:11541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11541:1869066311634048:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782480782.471953:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480782.472047:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291696384 00000100:00100000:1.0:1782480782.472058:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291696384 00000100:00100000:1.0:1782480782.472132:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 112 00000100:00100000:1.0:1782480782.472142:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+55:10537:x1869066291696384:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782480782.472171:0:5809:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782480782.472290:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+55:10537:x1869066291696384:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 149us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480782.472297:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 112 00000100:00100000:3.0:1782480782.480314:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480782.480450:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291696512 00000100:00100000:2.0:1782480782.480461:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291696512 00000100:00100000:2.0:1782480782.480542:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 113 00000100:00100000:2.0:1782480782.480553:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+55:10537:x1869066291696512:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1782480782.480638:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024239 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.480656:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024239 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.480669:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024239 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.480721:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024240 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.480728:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024240 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.480735:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024240 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.480790:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024247 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.480799:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.480833:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480782.480874:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1782480782.480878:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480782.480890:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.480901:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024239 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.480907:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024239 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.480914:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024239 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.480921:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8a00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480782.480925:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024239 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.480932:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024239 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.480944:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d4bddc700) 00010000:00010000:2.0:1782480782.480947:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480782.480951:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024239 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.480957:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024239 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.480980:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024240 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.480986:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024240 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.480991:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024240 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.480996:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480782.480999:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024240 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.481005:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024240 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.481012:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9b6d45d62b00) 00010000:00010000:2.0:1782480782.481014:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480782.481018:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024240 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.481023:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024240 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.481036:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.481041:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024247 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.481046:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024247 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.481059:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480782.481062:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024247 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.481083:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024247 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.481093:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:2.0:1782480782.481095:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480782.481098:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024247 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.481103:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024247 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480782.481184:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+55:10537:x1869066291696512:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 Request processed in 632us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480782.481194:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 113 00000100:00100000:2.0:1782480782.488606:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480782.489011:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291696768 00000100:00100000:0.0:1782480782.489021:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291696768 00000100:00100000:0.0:1782480782.489096:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 114 00000100:00100000:0.0:1782480782.489106:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+55:10537:x1869066291696768:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782480782.489126:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480782.489147:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02424e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f9c7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.489267:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024255 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.489282:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.489294:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480782.489306:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1782480782.489404:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.489412:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024255 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.489418:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024255 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.489424:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2dc00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480782.489428:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024255 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.489435:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024255 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.489447:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:0.0:1782480782.489451:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782480782.489455:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024255 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.489472:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024255 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.489533:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02424e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9c7 expref: 57 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.489545:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d4bddc700) 00010000:00010000:0.0:1782480782.489547:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782480782.489552:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02424e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9c7 expref: 57 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.489563:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2c200, rc 0) 00000100:00100000:0.0:1782480782.489631:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+56:10537:x1869066291696768:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 526us (1036us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1782480782.489640:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 114 00000100:00100000:3.0:1782480782.494267:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480782.494435:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291696896 00000100:00100000:0.0:1782480782.494446:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291696896 00000100:00100000:0.0:1782480782.494518:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00100000:0.0:1782480782.494529:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+56:10537:x1869066291696896:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782480782.494568:0:10450:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782480782.494690:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+56:10537:x1869066291696896:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 162us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480782.494697:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00100000:3.0:1782480782.503027:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480782.503183:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291697152 00000100:00100000:1.0:1782480782.503194:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291697152 00000100:00100000:1.0:1782480782.503256:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:1.0:1782480782.503267:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+56:10537:x1869066291697152:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480782.503287:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480782.503290:0:11544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782480782.503318:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c0241f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9ab expref: 56 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.503412:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:1.0:1782480782.503418:0:11544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782480782.503432:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024263 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f9ce expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782480782.504417:0:11544:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1782480782.504892:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c02426a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.504908:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c02426a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.504919:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c02426a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.504980:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024263 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9ce expref: 58 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.504999:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c02426a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9ce expref: 57 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.505008:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d5230ff00) 00010000:00010000:1.0:1782480782.505011:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782480782.505014:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572200, rc 0) 00000100:00100000:1.0:1782480782.505091:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+57:10537:x1869066291697152:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1826us (2073us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1782480782.505100:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:1.0:1782480782.531051:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480782.531162:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291697408 00000100:00100000:2.0:1782480782.531173:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291697408 00000100:00100000:2.0:1782480782.531238:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:2.0:1782480782.531248:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+57:10537:x1869066291697408:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782480782.531338:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480782.531367:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c02426a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9ce expref: 57 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.531388:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d5230ff00) 00010000:00010000:2.0:1782480782.531407:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782480782.531428:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024278 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.531453:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024278 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.531465:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024278 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.531545:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02427f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xd2a080f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.531554:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02427f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd2a080f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.531561:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02427f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd2a080f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.531639:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024278 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.531646:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024278 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.531653:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024278 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.531659:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480782.531663:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024278 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.531671:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024278 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.531687:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:2.0:1782480782.531690:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480782.531695:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024278 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.531700:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024278 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.531710:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02427f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd2a080f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.531717:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02427f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd2a080f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.531722:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02427f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd2a080f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.531727:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480782.531730:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02427f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd2a080f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.531737:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02427f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd2a080f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.531743:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xd2a080f4 (ffff9b6d45d62b00) 00010000:00010000:2.0:1782480782.531802:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480782.531806:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02427f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd2a080f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.531812:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02427f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd2a080f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480782.531897:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+56:10537:x1869066291697408:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 650us (856us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782480782.531905:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:3.0:1782480782.538415:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480782.538526:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291697536 00000100:00100000:2.0:1782480782.538536:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291697536 00000100:00100000:2.0:1782480782.538638:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 118 00000100:00100000:2.0:1782480782.538649:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+56:10537:x1869066291697536:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782480782.538668:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480782.538690:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024286 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f9d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.538722:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02428d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.538735:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02428d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.538775:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02428d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.538873:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024286 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9d5 expref: 58 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.538891:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02428d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9d5 expref: 57 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.538900:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d45d62d00) 00010000:00010000:2.0:1782480782.538910:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782480782.538914:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e8a00, rc 0) 00000100:00100000:2.0:1782480782.538965:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+57:10537:x1869066291697536:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 318us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480782.538972:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 118 00000100:00100000:1.0:1782480782.547102:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480782.547916:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291697792 00000100:00100000:2.0:1782480782.547928:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291697792 00000100:00100000:2.0:1782480782.547992:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00100000:2.0:1782480782.548003:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+57:10537:x1869066291697792:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782480782.548101:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024294 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.548119:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024294 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.548130:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024294 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782480782.548372:0:11544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1782480782.548383:0:11544:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 403389635266ns, next at 404389632475ns, rc = 0 00000004:00010000:2.0:1782480782.549232:0:11544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003aee196d reply state 000000002bb944a4 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024294 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480782.549246:0:11544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782480782.549358:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+59:10537:x1869066291697792:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 1354us (2263us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1782480782.549366:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 119 00010000:00010000:0.0:1782480782.551279:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024294 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.551295:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024294 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.551317:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024294 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.551324:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480782.551329:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024294 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.551337:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024294 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.551353:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d45d62d00) 00010000:00010000:0.0:1782480782.551356:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782480782.551361:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024294 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.551367:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024294 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480782.552501:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480782.552572:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291697920 00000100:00100000:0.0:1782480782.552581:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291697920 00000100:00100000:0.0:1782480782.552643:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:0.0:1782480782.552653:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+58:10537:x1869066291697920:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782480782.552678:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480782.552695:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02429b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f9dc expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.552788:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02429b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9dc expref: 59 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.552821:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02429b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9dc expref: 59 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.552843:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d45d62d00) 00010000:00010000:0.0:1782480782.552846:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782480782.552849:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2c200, rc 0) 00000100:00100000:0.0:1782480782.552901:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+59:10537:x1869066291697920:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 249us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480782.552908:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:1.0:1782480782.562944:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480782.563264:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291698048 00000100:00100000:0.0:1782480782.563274:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291698048 00000100:00100000:0.0:1782480782.563329:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:0.0:1782480782.563339:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2367:x1869066291698048:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1782480782.563647:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+9:2367:x1869066291698048:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 308us (713us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1782480782.563655:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:3.0:1782480782.573525:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480782.573633:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291698304 00000100:00100000:1.0:1782480782.573642:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291698304 00000100:00100000:1.0:1782480782.573701:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:1.0:1782480782.573711:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+59:10537:x1869066291698304:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782480782.574010:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+60:10537:x1869066291698304:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 299us (495us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1782480782.574018:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:3.0:1782480782.576895:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480782.576994:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291698560 00000100:00100000:2.0:1782480782.577002:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291698560 00000100:00100000:2.0:1782480782.577226:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:2.0:1782480782.577237:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+60:10537:x1869066291698560:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782480782.577349:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+60:10537:x1869066291698560:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 114us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480782.577357:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:2.0:1782480782.580299:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480782.580544:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291698688 00000100:00100000:1.0:1782480782.580554:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291698688 00000100:00100000:1.0:1782480782.580667:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:1.0:1782480782.580678:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+60:10537:x1869066291698688:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480782.580704:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480782.580726:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0242a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f9e3 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.580831:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c0242a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.580847:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c0242a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.580859:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c0242a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480782.580899:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782480782.580917:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c0242a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.580946:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0242a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9e3 expref: 62 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.580965:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c0242a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9e3 expref: 61 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.580992:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d45d62d00) 00010000:00010000:1.0:1782480782.580996:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1782480782.581000:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572600, rc 0) 00000100:00100000:1.0:1782480782.581078:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+61:10537:x1869066291698688:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 402us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480782.581084:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:3.0:1782480782.602896:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480782.602977:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291698816 00000100:00100000:0.0:1782480782.602987:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291698816 00000100:00100000:0.0:1782480782.603042:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:0.0:1782480782.603052:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+9:2367:x1869066291698816:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782480782.603070:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480782.603091:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d58c7789/0x3dc3ebf33c0242b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f9ea expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782480782.603118:0:8678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3e7f8f, blocks: 0x1 00010000:00010000:0.0:1782480782.603150:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=403s v=(0 0) 00010000:00010000:0.0:1782480782.603155:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480782.603165:0:8678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d58c7789/0x3dc3ebf33c0242b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9ea expref: 10 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.603183:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d58c7789/0x3dc3ebf33c0242b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9ea expref: 10 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.603197:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2dc00, rc 0) 00000100:00100000:0.0:1782480782.603259:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+10:2367:x1869066291698816:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 208us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480782.603267:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:3.0:1782480782.621097:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480782.621270:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291699072 00000100:00100000:2.0:1782480782.621279:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291699072 00000100:00100000:2.0:1782480782.621348:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:2.0:1782480782.621358:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+61:10537:x1869066291699072:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782480782.621470:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+61:10537:x1869066291699072:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 112us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480782.621478:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:2.0:1782480782.627936:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480782.629686:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291699200 00000100:00100000:0.0:1782480782.629702:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291699200 00000100:00100000:0.0:1782480782.629806:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:0.0:1782480782.629817:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+10:10537:x1869066291699200:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782480782.629836:0:6604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480782.629854:0:6604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c0242b7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f9f1 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.629904:0:6604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d58c7789/0x3dc3ebf33c0242b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9ea expref: 11 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.629915:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480782.629920:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480782.629926:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c0242b7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9f1 expref: 11 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.629977:0:6604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d58c7789/0x3dc3ebf33c0242b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9ea expref: 11 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.629992:0:6604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d58c7789/0x3dc3ebf33c0242b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9ea expref: 11 pid: 8678 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480782.630009:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6604:1869066311634176:192.168.204.51@tcp:104: 00000100:00100000:0.0:1782480782.630112:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45d65f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782480782.633670:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6604:1869066311634176:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480782.633711:0:6604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c0242b7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9f1 expref: 11 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.633734:0:6604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2c600, rc 0) 00000100:00100000:0.0:1782480782.633848:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+11:10537:x1869066291699200:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 4032us (5922us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480782.633858:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:3.0:1782480782.633970:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480782.634128:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291699328 00000100:00100000:1.0:1782480782.634136:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291699328 00010000:00010000:1.0:1782480782.634170:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d58c7789/0x3dc3ebf33c0242b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9ea expref: 11 pid: 8678 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480782.634202:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:1.0:1782480782.634212:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75578e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+11:2366:x1869066291699328:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480782.634228:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480782.634250:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d58c7789/0x3dc3ebf33c0242b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9ea expref: 11 pid: 8678 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.634263:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d58c7789/0x3dc3ebf33c0242b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9ea expref: 11 pid: 8678 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.634285:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d58c7789/0x3dc3ebf33c0242b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9ea expref: 11 pid: 8678 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.634300:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480782.634317:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480782.634326:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c0242b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9f1 expref: 10 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.634336:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c0242b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9f1 expref: 10 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.634373:0:5794:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c0242b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9f1 expref: 10 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480782.634388:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d757c4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5794:1869066311634304:192.168.204.51@tcp:105: 00000100:00100000:1.0:1782480782.634465:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46a5bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1782480782.647809:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d757c4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5794:1869066311634304:192.168.204.51@tcp:105: 00010000:00010000:1.0:1782480782.647834:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480782.647913:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75578e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+10:2366:x1869066291699328:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 13701us (13944us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480782.647924:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:3.0:1782480782.649301:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480782.649724:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291699456 00000100:00100000:1.0:1782480782.649733:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291699456 00002000:00100000:1.0:1782480782.649830:0:6609:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9b6d75579500 x1869066291699456/t0(0) o4->49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp:538/0 lens 504/0 e 0 to 0 dl 1782480793 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782480782.649847:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d75579500 with x1869066291699456 ext(0->12) 00002000:00010000:1.0:1782480782.649853:0:6609:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d75579500 00000100:00100000:1.0:1782480782.649894:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:1.0:1782480782.649903:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75579500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+10:2366:x1869066291699456:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1782480782.650699:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75579500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+12:2366:x1869066291699456:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 Request processed in 794us (1400us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1782480782.650707:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00002000:00100000:1.0:1782480782.650715:0:6609:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9b6d75579500 x1869066291699456/t4294967308(0) o4->49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp:538/0 lens 504/448 e 0 to 0 dl 1782480793 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782480782.650729:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d75579500 with x1869066291699456 ext(0->12) 00002000:00010000:1.0:1782480782.650734:0:6609:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d75579500 00000100:00100000:2.0:1782480782.665477:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480782.666619:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291699584 00000100:00100000:1.0:1782480782.666631:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291699584 00000100:00100000:1.0:1782480782.666699:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 124 00000100:00100000:1.0:1782480782.666710:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+61:10537:x1869066291699584:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1782480782.735370:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000004:00080000:3.0:1782480782.735391:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1782480782.735416:0:5829:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b6d452653c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1782480782.735421:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9b6d7b232400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d45265d80 00000020:00080000:3.0:1782480782.735424:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9b6d7b232300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d7f21d400 00000020:00080000:3.0:1782480782.735456:0:5829:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b6d5239d0c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1782480782.735459:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9b6d7b232c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d5239d240 00000020:00080000:3.0:1782480782.735462:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9b6d7b232500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d7f147800 00000100:00100000:3.0:1782480782.735888:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311634432:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1782480782.735956:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480782.736080:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311634432 00000100:00100000:0.0:1782480782.736089:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311634432 00000100:00100000:0.0:1782480782.736138:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782480782.736146:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3318:x1869066311634432:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782480782.736170:0:6602:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1782480782.736199:0:6602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a3e7f8d, atime: 0x6a3e7f8e, ctime: 0x6a3e7f8d, blocks: 0x1 00010000:00010000:0.0:1782480782.736207:0:6602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000716a483e/0x3dc3ebf33c0242be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.736233:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=403s v=(0 0) 00010000:00010000:0.0:1782480782.736237:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480782.736243:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000716a483e/0x3dc3ebf33c0242be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.736257:0:6602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000716a483e/0x3dc3ebf33c0242be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.736267:0:6602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000716a483e/0x3dc3ebf33c0242be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.736274:0:6602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000716a483e/0x3dc3ebf33c0242be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.736289:0:6602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782480782.737133:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3318:x1869066311634432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 985us (1174us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1782480782.737142:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:3.0:1782480782.737231:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d755d8000/2, rc 0, transno 4294967304 00000100:00100000:3.0:1782480782.737237:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311634432:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782480782.737339:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480782.737347:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000716a483e/0x3dc3ebf33c0242be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.737357:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c000 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480782.737361:0:7486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000716a483e/0x3dc3ebf33c0242be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.737370:0:7486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000716a483e/0x3dc3ebf33c0242be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.737388:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000716a483e/0x3dc3ebf33c0242be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.737408:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000716a483e/0x3dc3ebf33c0242be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.737429:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480782.737430:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480782.737432:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782480782.737554:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1782480782.737588:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:3.0:1782480782.737621:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:3.0:1782480782.737917:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311634560:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782480782.737960:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480782.738004:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480782.738011:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311634688:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1782480782.738030:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480782.738055:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311634560 00000100:00100000:3.0:1782480782.738061:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311634560 00000100:00100000:3.0:1782480782.738099:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311634688 00000100:00100000:3.0:1782480782.738102:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311634688 00000100:00100000:3.0:1782480782.738122:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782480782.738130:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1869066311634560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782480782.738151:0:6604:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1782480782.738173:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ee73737/0x3dc3ebf33c0242c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480782.738190:0:6604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c024080 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f950 expref: 11 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480782.738198:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1782480782.738202:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782480782.738205:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ee73737/0x3dc3ebf33c0242c5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480782.738231:0:6604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c024080 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f950 expref: 11 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480782.738245:0:6604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c024080 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f950 expref: 11 pid: 6604 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480782.738265:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7557a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6604:1869066311634816:192.168.204.51@tcp:104: 00000100:00100000:3.0:1782480782.738394:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75626c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480782.738514:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782480782.738523:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3315:x1869066311634688:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1782480782.738816:0:8678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1782480782.738820:0:8678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782480783 00002000:00010000:3.0:1782480782.738822:0:8678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1782480782.738825:0:8678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1782480783 -> 1782480783 00002000:00010000:3.0:1782480782.738826:0:8678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1782480782.738876:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3315:x1869066311634688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 353us (844us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1782480782.738883:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:0.0:1782480782.739210:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d755db800/2, rc 0, transno 4294967309 00000100:00100000:0.0:1782480782.739217:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311634688:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1782480782.739459:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:3.0:1782480782.739548:0:5841:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1782480782.739818:0:5841:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1782480782.740102:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+15:10537:x1869066291699584:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 Request processed in 73390us (74631us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480782.740112:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 124 00000100:00100000:3.0:1782480782.742192:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480782.742263:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291699712 00000100:00100000:2.0:1782480782.742272:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291699712 00010000:00010000:2.0:1782480782.742326:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c024080 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f950 expref: 12 pid: 6604 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480782.742371:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:2.0:1782480782.742380:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75578a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+12:2367:x1869066291699712:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480782.742414:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480782.742420:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c024080 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f950 expref: 12 pid: 6604 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.742434:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c024080 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f950 expref: 12 pid: 6604 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.742458:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782480782.742463:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782480782.742468:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ee73737/0x3dc3ebf33c0242c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.742487:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ee73737/0x3dc3ebf33c0242c5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.742509:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480782.742563:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75578a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+12:2367:x1869066291699712:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 184us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480782.742570:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:2.0:1782480782.746489:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00010000:00010000:0.0:1782480782.748071:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c024080 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f950 expref: 11 pid: 6604 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480782.748096:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7557a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6604:1869066311634816:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480782.748141:0:6604:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006ee73737/0x3dc3ebf33c0242c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480782.748469:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291699840 00000100:00100000:1.0:1782480782.748487:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291699840 00000100:00100000:1.0:1782480782.748586:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:1.0:1782480782.748596:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+11:2367:x1869066291699840:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1782480782.748807:0:6604:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006ee73737/0x3dc3ebf33c0242c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.748818:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ee73737/0x3dc3ebf33c0242c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.748828:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ee73737/0x3dc3ebf33c0242c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.748837:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ee73737/0x3dc3ebf33c0242c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.748854:0:6604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782480782.749470:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3315:x1869066311634560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11339us (11507us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1782480782.749491:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:2.0:1782480782.750042:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d755d9880/2, rc 0, transno 4294967310 00000100:00100000:2.0:1782480782.750050:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311634560:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782480782.750145:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480782.750153:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ee73737/0x3dc3ebf33c0242c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.750164:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ec800 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480782.750168:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ee73737/0x3dc3ebf33c0242c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.750177:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ee73737/0x3dc3ebf33c0242c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.750197:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ee73737/0x3dc3ebf33c0242c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.750218:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ee73737/0x3dc3ebf33c0242c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.750237:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480782.750239:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480782.750241:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782480782.784376:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1782480782.784395:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1782480782.784401:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1782480782.784521:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2367:x1869066291699840:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 Request processed in 35921us (38045us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480782.784531:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:1.0:1782480782.787744:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480782.788081:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291700096 00000100:00100000:2.0:1782480782.788091:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291700096 00000100:00100000:2.0:1782480782.788156:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 125 00000100:00100000:2.0:1782480782.788167:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+15:10537:x1869066291700096:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782480782.788241:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480782.788267:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c0242a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9e3 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.788286:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d45d62d00) 00010000:00010000:2.0:1782480782.788290:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782480782.788318:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0242cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.788332:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0242cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.788341:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0242cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480782.788996:0:5809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f54737ca reply state 000000003ac0d6c5 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0242cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480782.789007:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782480782.789215:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+16:10537:x1869066291700096:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 1048us (1478us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1782480782.789224:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 125 00010000:00010000:1.0:1782480782.790776:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0242cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.790791:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0242cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.790799:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0242cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.790805:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480782.790810:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0242cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.790818:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0242cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.790923:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d45d62d00) 00010000:00010000:1.0:1782480782.790926:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480782.790931:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0242cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.790937:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0242cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480782.792089:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480782.792221:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291700224 00000100:00100000:3.0:1782480782.792230:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291700224 00000100:00100000:3.0:1782480782.792292:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:3.0:1782480782.792302:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2367:x1869066291700224:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1782480782.792552:0:6602:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1782480782.792556:0:6602:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1782480783 -> 1782480782 00002000:00010000:3.0:1782480782.792558:0:6602:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1782480782 00002000:00010000:3.0:1782480782.792560:0:6602:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1782480783 -> 1782480782 00002000:00010000:3.0:1782480782.792562:0:6602:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1782480782.792975:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2367:x1869066291700224:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 673us (890us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1782480782.792984:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:3.0:1782480782.795185:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480782.795280:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291700480 00000100:00100000:1.0:1782480782.795289:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291700480 00000100:00100000:1.0:1782480782.795347:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 126 00000100:00100000:1.0:1782480782.795356:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+15:10537:x1869066291700480:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1782480782.795418:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.795432:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02428d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9d5 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.795441:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242d3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.795473:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02428d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9d5 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.795497:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02428d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9d5 expref: 15 pid: 5807 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480782.795513:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d757c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1869066311634944:192.168.204.51@tcp:104: 00000100:00100000:1.0:1782480782.795784:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46a5bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1782480782.799459:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480782.799558:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291700608 00000100:00100000:3.0:1782480782.799611:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291700608 00010000:00010000:3.0:1782480782.800453:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02428d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9d5 expref: 16 pid: 5807 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480782.800518:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:0.0:1782480782.800531:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+16:2366:x1869066291700608:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480782.800547:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480782.800555:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02428d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9d5 expref: 16 pid: 5807 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.800568:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02428d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9d5 expref: 16 pid: 5807 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.800600:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d45d62d00) 00010000:00010000:0.0:1782480782.800606:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.800615:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.800623:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242d3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.800635:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c02428d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9d5 expref: 16 pid: 5807 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480782.800653:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d757c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1869066311634944:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480782.800661:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782480782.800671:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.800680:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.800685:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.800714:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480782.800715:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+15:2366:x1869066291700608:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 188us (1265us total) trans 0 rc 0/0 00010000:00010000:1.0:1782480782.800722:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480782.800724:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00010000:00010000:1.0:1782480782.800728:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.800733:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572a00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480782.800737:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.800978:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.800992:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d45d62d00) 00010000:00010000:1.0:1782480782.801001:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1782480782.801005:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.801011:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480782.801061:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+14:10537:x1869066291700480:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 Request processed in 5705us (5889us total) trans 0 rc -22/-22 00000100:00100000:1.0:1782480782.801070:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 126 00000100:00100000:2.0:1782480782.804315:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480782.804419:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291700736 00000100:00100000:0.0:1782480782.804429:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291700736 00000100:00100000:0.0:1782480782.805212:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:0.0:1782480782.805224:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2366:x1869066291700736:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1782480782.805265:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0242da lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.805282:0:6604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c0242b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9f1 expref: 7 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.805289:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480782.805293:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782480782.805297:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0242da lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.805339:0:6604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c0242b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9f1 expref: 7 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.805350:0:6604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c0242b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9f1 expref: 7 pid: 6604 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480782.805365:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6604:1869066311635072:192.168.204.51@tcp:104: 00000100:00100000:0.0:1782480782.805443:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45d65840 going to sleep for 11 seconds 00000100:00100000:3.0:1782480782.808274:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480782.808368:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291700864 00000100:00100000:2.0:1782480782.808375:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291700864 00010000:00010000:2.0:1782480782.808407:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c0242b7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9f1 expref: 8 pid: 6604 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480782.808457:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:2.0:1782480782.808486:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2367:x1869066291700864:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480782.808503:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480782.808522:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c0242b7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9f1 expref: 8 pid: 6604 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.808532:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c0242b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9f1 expref: 8 pid: 6604 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.808553:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782480782.808556:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782480782.808560:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0242da lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.808566:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0242da lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.808580:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480782.808626:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2367:x1869066291700864:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 161us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480782.808633:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 58 00010000:00010000:0.0:1782480782.808795:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c0242b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9f1 expref: 7 pid: 6604 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480782.808811:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6604:1869066311635072:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480782.808827:0:6604:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0242da lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.808834:0:6604:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0242da lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.808838:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0242da lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.808859:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0242da lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.808878:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0242da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.808886:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0242da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.808893:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2d200 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:0.0:1782480782.808898:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0242da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.808908:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0242da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.809097:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0242da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.809106:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0242da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480782.809166:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2366:x1869066291700736:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 Request processed in 3944us (4863us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480782.809173:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:3.0:1782480782.811686:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480782.811929:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291701120 00000100:00100000:2.0:1782480782.811938:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291701120 00000100:00100000:2.0:1782480782.811990:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 127 00000100:00100000:2.0:1782480782.812000:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+14:10537:x1869066291701120:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782480782.812087:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0242e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.812104:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0242e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.812114:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0242e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.812364:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0242e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.812376:0:11544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02429b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9dc expref: 15 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.812383:0:11544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0242e8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.812414:0:11544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02429b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9dc expref: 15 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.812426:0:11544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02429b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9dc expref: 15 pid: 10450 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480782.812438:0:11544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f05880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11544:1869066311635200:192.168.204.51@tcp:104: 00000100:00100000:2.0:1782480782.812534:0:11544:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6c42ca7240 going to sleep for 11 seconds 00000100:00100000:2.0:1782480782.816185:0:11544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f05880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11544:1869066311635200:192.168.204.51@tcp:104: 00010000:00010000:2.0:1782480782.816215:0:11544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0242e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480782.820141:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480782.820404:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291701248 00000100:00100000:2.0:1782480782.820415:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291701248 00010000:00010000:2.0:1782480782.820456:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02429b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9dc expref: 16 pid: 10450 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480782.820508:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:2.0:1782480782.820517:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+16:2367:x1869066291701248:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480782.820533:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480782.820539:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02429b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9dc expref: 16 pid: 10450 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.820551:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02429b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9dc expref: 16 pid: 10450 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.820573:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02429b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9dc expref: 16 pid: 10450 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.820591:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d45d62d00) 00010000:00010000:2.0:1782480782.820596:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0242e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.820604:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0242e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.820611:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0242e8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.820654:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480782.820721:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+15:2367:x1869066291701248:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 204us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480782.820729:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 59 00010000:00010000:1.0:1782480782.821267:0:11544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0242e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.821277:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0242e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782480782.821462:0:11544:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1782480782.821637:0:11544:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1782480782.822374:0:11544:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1782480782.823133:0:11544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d757c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11544:1869066311635328:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782480782.823198:0:11544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480782.823231:0:11544:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d487f6600 going to sleep for 11 seconds 00000100:00100000:2.0:1782480782.824073:0:5813:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311635328 00000100:00100000:2.0:1782480782.824082:0:5813:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311635328 00000100:00100000:2.0:1782480782.824136:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782480782.824146:0:5813:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11544:x1869066311635328:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1782480782.824241:0:5813:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11544:x1869066311635328:12345-0@lo:1000:mdt00_004.0 Request processed in 96us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480782.824248:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782480782.824402:0:11544:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1782480782.824408:0:11544:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1782480782.824431:0:11544:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d755db800, transno 4294967309 00000004:00080000:3.0:1782480782.824503:0:11544:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d755d9880, transno 4294967310 00000100:00100000:3.0:1782480782.825641:0:11544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d757c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11544:1869066311635328:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1782480782.827351:0:11544:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1782480782.827441:0:11544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11544:1869066311635456:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1782480782.827583:0:11544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480782.827725:0:11544:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d756263c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480782.828102:0:5813:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311635456 00000100:00100000:2.0:1782480782.828110:0:5813:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311635456 00000100:00100000:2.0:1782480782.828196:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782480782.828207:0:5813:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11544:x1869066311635456:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1782480782.828408:0:5813:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11544:x1869066311635456:12345-0@lo:1000:mdt00_004.0 Request processed in 201us (823us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1782480782.828415:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782480782.828509:0:11544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11544:1869066311635456:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1782480782.828544:0:11544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0242e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480782.828555:0:11544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0242e8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480782.828577:0:11544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0242e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480782.828584:0:11544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480782.828589:0:11544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0242e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480782.828598:0:11544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0242e8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480782.828615:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d45d62d00) 00010000:00010000:3.0:1782480782.828620:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782480782.828624:0:11544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0242e8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480782.828642:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0242e8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480782.828678:0:11544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02422b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480782.828684:0:11544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02422b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480782.828690:0:11544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02422b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480782.828695:0:11544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573600 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480782.828698:0:11544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02422b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480782.828715:0:11544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02422b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480782.828725:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:3.0:1782480782.828727:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782480782.828734:0:11544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c024232 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9c0 expref: 18 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480782.829015:0:11544:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c024232 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9c0 expref: 18 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480782.829025:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c024232 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9c0 expref: 18 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480782.829056:0:11544:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c024232 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9c0 expref: 18 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480782.829068:0:11544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11544:1869066311635584:192.168.204.51@tcp:105: 00000100:00100000:3.0:1782480782.829138:0:11544:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d756263c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480782.832471:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480782.832576:0:11544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11544:1869066311635584:192.168.204.51@tcp:105: 00010000:00010000:1.0:1782480782.832603:0:11544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02422b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.832614:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02422b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.832661:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.832693:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.832705:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.832716:0:11544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.832723:0:11544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242ef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.832729:0:11544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.832734:0:11544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572a00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480782.832766:0:11544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.832775:0:11544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242ef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.832786:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:1.0:1782480782.832789:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480782.832792:0:11544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242ef lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.832798:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242ef lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.832808:0:11544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0242e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.832820:0:11544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0242e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.832826:0:11544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0242e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.832831:0:11544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480782.832834:0:11544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0242e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.832841:0:11544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0242e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.832849:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:1.0:1782480782.832852:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782480782.832855:0:11544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0242e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.832860:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0242e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480782.833205:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+18:10537:x1869066291701120:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 21205us (21525us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1782480782.833216:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 127 00000020:00080000:1.0:1782480782.833222:0:11544:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1782480782.833453:0:11541:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782480782.833458:0:11541:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782480782.834302:0:11541:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1782480782.834316:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782480782.834851:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291701376 00000100:00100000:0.0:1782480782.834860:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291701376 00000100:00100000:0.0:1782480782.834928:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:0.0:1782480782.834953:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+18:10536:x1869066291701376:12345-192.168.204.51@tcp:49:lfs.0 00000100:00100000:0.0:1782480782.835082:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+18:10536:x1869066291701376:12345-192.168.204.51@tcp:49:lfs.0 Request processed in 131us (2626us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480782.835090:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:3.0:1782480782.837994:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480782.838090:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291701632 00000100:00100000:0.0:1782480782.838098:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291701632 00000100:00100000:0.0:1782480782.838176:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:0.0:1782480782.838186:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45d54c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+18:10537:x1869066291701632:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1782480782.838943:0:5811:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1782480782.839047:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1782480782.839093:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0242f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.839113:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0242f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.839124:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0242f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.839133:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0242f6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.839139:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0242f6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.839146:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0242f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.839163:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782480782.839196:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480782.839202:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0242f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.839209:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c600 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480782.839219:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0242f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.839227:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0242f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.839239:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b6d43255600) 00010000:00010000:1.0:1782480782.839242:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782480782.839246:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0242f6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.839252:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0242f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480782.839259:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45d54c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+20:10537:x1869066291701632:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 1074us (1271us total) trans 4294967408 rc 0/0 00010000:00010000:1.0:1782480782.839269:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480782.839271:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480782.839272:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480782.839273:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 32 00000020:00080000:0.0:1782480782.839278:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782480782.840060:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480782.840223:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291701888 00000100:00100000:2.0:1782480782.840231:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291701888 00000100:00100000:2.0:1782480782.840269:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 128 00000100:00100000:2.0:1782480782.840278:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+20:10536:x1869066291701888:12345-192.168.204.51@tcp:58:lfs.0 00000040:00080000:2.0:1782480782.840502:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1782480782.840572:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+20:10536:x1869066291701888:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 295us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480782.840581:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 128 00000100:00100000:3.0:1782480782.873304:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480782.873603:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291702016 00000100:00100000:1.0:1782480782.873613:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291702016 00000100:00100000:1.0:1782480782.873817:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 129 00000100:00100000:1.0:1782480782.873828:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+20:10539:x1869066291702016:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1782480782.873851:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480782.873870:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f9f8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.874401:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c024304 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.874416:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c024304 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.874447:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c024304 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.874602:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c02430b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.874612:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c02430b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480782.874620:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c02430b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.876325:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024312 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.876354:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02421d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9b9 expref: 21 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.876363:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024312 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.876398:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02421d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9b9 expref: 21 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.876414:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02421d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9b9 expref: 21 pid: 5809 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480782.876428:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f05880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1869066311635712:192.168.204.51@tcp:104: 00000100:00100000:2.0:1782480782.876665:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6c42ca7240 going to sleep for 11 seconds 00000100:00100000:0.0:1782480782.881244:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480782.881318:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291702272 00000100:00100000:3.0:1782480782.881340:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291702272 00000100:00100000:3.0:1782480782.881435:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:3.0:1782480782.881446:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+22:6041:x1869066291702272:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782480782.882106:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+23:6041:x1869066291702272:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 659us (868us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1782480782.882115:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:2.0:1782480782.882249:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f05880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1869066311635712:192.168.204.51@tcp:104: 00010000:00010000:2.0:1782480782.882367:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024312 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480782.883934:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480782.884072:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291702400 00000100:00100000:2.0:1782480782.884080:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291702400 00010000:00010000:2.0:1782480782.884115:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02421d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9b9 expref: 23 pid: 5809 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480782.884152:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:2.0:1782480782.884161:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d465fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+23:2367:x1869066291702400:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480782.884175:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480782.884198:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02421d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9b9 expref: 23 pid: 5809 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.884211:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02421d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9b9 expref: 23 pid: 5809 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.884234:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02421d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9b9 expref: 23 pid: 5809 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.884247:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:2.0:1782480782.884253:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024312 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.884261:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.884269:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024312 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480782.884339:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480782.884391:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d465fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+22:2367:x1869066291702400:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 230us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480782.884398:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00010000:00010000:0.0:1782480782.884560:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.884568:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480782.884609:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1782480782.884614:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480782.884698:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.884711:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.884721:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c024304 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.884727:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c024304 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.884734:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c024304 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.884776:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573600 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480782.884780:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c024304 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.884798:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c024304 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.884808:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:0.0:1782480782.884811:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480782.884815:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c024304 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.884821:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c024304 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.884831:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c02430b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.884837:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c02430b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.884966:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c02430b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.884974:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480782.884978:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c02430b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.884984:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c02430b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.884993:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b6d5230f700) 00010000:00010000:0.0:1782480782.884995:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480782.884998:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c02430b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.885014:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c02430b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.885051:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c0242fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9f8 expref: 22 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.885064:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024312 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9f8 expref: 21 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480782.885071:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:0.0:1782480782.885074:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782480782.885076:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9600, rc 0) 00000100:00100000:0.0:1782480782.885104:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+21:10539:x1869066291702016:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 11279us (11810us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480782.885111:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 129 00010000:00010000:1.0:1782480783.032205:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480783.094929:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782480783.094951:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311635840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480783.095293:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480783.095604:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311635840 00000100:00100000:0.0:1782480783.095612:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311635840 00000100:00100000:0.0:1782480783.095666:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782480783.095676:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3318:x1869066311635840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782480783.095697:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 3407872 free 3859808256 avail 3857711104 00000100:00080000:1.0:1782480783.095721:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480783.095743:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3318:x1869066311635840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480783.095770:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782480783.097638:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311635840:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1782480783.154880:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1782480783.154902:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:3.0:1782480783.154915:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1782480783.447110:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480783.447156:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480783.447191:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480783.447225:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480783.447248:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480783.447611:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291703040 00000100:00100000:2.0:1782480783.447621:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291703040 00000100:00100000:2.0:1782480783.447690:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291702656 00000100:00100000:2.0:1782480783.447694:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291702656 00000100:00100000:2.0:1782480783.447719:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 136 00000100:00100000:2.0:1782480783.447728:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2367:x1869066291703040:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480783.447833:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2367:x1869066291703040:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 106us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480783.447857:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 136 00000100:00100000:2.0:1782480783.447877:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 137 00000100:00100000:2.0:1782480783.447884:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+21:2367:x1869066291702656:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480783.447915:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+21:2367:x1869066291702656:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 32us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480783.447921:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 137 00000100:00100000:3.0:1782480783.448115:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291702528 00000100:00100000:3.0:1782480783.448121:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291702528 00000100:00100000:3.0:1782480783.448164:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 288 00000100:00100000:3.0:1782480783.448221:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d68bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2367:x1869066291702528:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480783.448269:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d68bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2367:x1869066291702528:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 98us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480783.448277:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 288 00000100:00080000:1.0:1782480783.448343:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480783.449223:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291702784 00000100:00100000:0.0:1782480783.449231:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291702784 00000100:00080000:0.0:1782480783.449487:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480783.449586:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291702912 00000100:00100000:1.0:1782480783.449590:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291702912 00000100:00100000:1.0:1782480783.449634:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:1.0:1782480783.449644:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2367:x1869066291702784:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480783.449703:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2367:x1869066291702784:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 61us (2547us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480783.449710:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:1.0:1782480783.449727:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00100000:1.0:1782480783.449768:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2367:x1869066291702912:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480783.449797:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2367:x1869066291702912:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 52us (2548us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480783.449804:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00080000:0.0:1782480783.449965:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1782480783.656330:0:11911:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782480783.656338:0:11911:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782480783.656413:0:11911:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1782480783.656420:0:11911:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1782480783.864739:0:11541:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782480783.864759:0:11541:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782480783.864809:0:11541:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1782480783.864816:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782480783.866137:0:11541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11541:1869066311635968:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782480783.866316:0:11541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75626c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782480783.879395:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480783.879596:0:11541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11541:1869066311635968:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782480783.880332:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291703168 00000100:00100000:2.0:1782480783.880340:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291703168 00000100:00100000:2.0:1782480783.880408:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 130 00000100:00100000:2.0:1782480783.880417:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+21:10552:x1869066291703168:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782480783.880447:0:5807:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782480783.880845:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+21:10552:x1869066291703168:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 427us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480783.880853:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 130 00000100:00100000:2.0:1782480783.893776:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480783.894165:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291703424 00000100:00100000:3.0:1782480783.894176:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291703424 00000100:00100000:3.0:1782480783.894240:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 131 00000100:00100000:3.0:1782480783.894250:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+21:10552:x1869066291703424:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480783.894271:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480783.894289:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c024319 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3f9ff expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480783.894404:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024320 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480783.894418:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480783.894432:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024320 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480783.894443:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1782480783.894828:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c024319 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9ff expref: 24 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480783.894847:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024320 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9ff expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480783.894857:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:3.0:1782480783.894859:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480783.894863:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ec000, rc 0) 00000100:00100000:3.0:1782480783.895065:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+23:10552:x1869066291703424:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 815us (1320us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1782480783.895086:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 131 00000100:00100000:2.0:1782480783.910570:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480783.912382:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480783.912422:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291703808 00000100:00100000:2.0:1782480783.912432:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291703808 00000100:00100000:2.0:1782480783.912621:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:2.0:1782480783.912633:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+23:2367:x1869066291703808:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480783.912651:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480783.912676:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024320 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9ff expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480783.912706:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:2.0:1782480783.912712:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480783.912783:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+22:2367:x1869066291703808:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 153us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480783.912791:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:0.0:1782480783.917646:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291703680 00000100:00100000:0.0:1782480783.917660:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291703680 00000100:00100000:0.0:1782480783.923860:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 132 00000100:00100000:0.0:1782480783.923882:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+22:10552:x1869066291703680:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1782480783.923977:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c02432e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480783.923995:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c02432e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480783.924007:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c02432e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480783.924192:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c02432e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480783.924199:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c02432e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480783.924206:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c02432e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480783.924211:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2d400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480783.924215:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c02432e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480783.924223:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c02432e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480783.924236:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:0.0:1782480783.924247:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782480783.924252:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c02432e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480783.924259:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c02432e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480783.924408:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+23:10552:x1869066291703680:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 533us (13849us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1782480783.924417:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 132 00000040:00080000:1.0:1782480783.926954:0:11541:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782480783.926962:0:11541:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782480783.928530:0:11541:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1782480783.928546:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782480783.942041:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480783.943972:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291704064 00000100:00100000:0.0:1782480783.943985:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291704064 00000100:00100000:0.0:1782480783.944043:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:0.0:1782480783.944052:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+23:10552:x1869066291704064:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782480783.944261:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+24:10552:x1869066291704064:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 209us (2226us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1782480783.944268:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00010000:00010000:1.0:1782480784.057252:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480785.079195:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782480785.649330:0:11962:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782480785.649340:0:11962:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782480785.649385:0:11962:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1782480785.649391:0:11962:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782480785.858807:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480785.858891:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291704320 00000100:00100000:1.0:1782480785.858901:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291704320 00000100:00100000:1.0:1782480785.858971:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 133 00000100:00100000:1.0:1782480785.858982:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+24:10572:x1869066291704320:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1782480785.859006:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480785.859028:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024335 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa06 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480785.859153:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c02433c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480785.859167:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c02433c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480785.859180:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c02433c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480785.859214:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1782480785.859340:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024335 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa06 expref: 27 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480785.859358:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c02433c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa06 expref: 26 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480785.859367:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:1.0:1782480785.859370:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782480785.859373:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572a00, rc 0) 00000100:00100000:1.0:1782480785.859439:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+26:10572:x1869066291704320:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 459us (642us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1782480785.859446:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 133 00000100:00080000:2.0:1782480785.859614:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480785.870107:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480785.875218:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291704448 00000100:00100000:2.0:1782480785.875232:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291704448 00000100:00100000:2.0:1782480785.875290:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 134 00000100:00100000:2.0:1782480785.875300:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+26:10572:x1869066291704448:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:2.0:1782480785.875367:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c02434a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480785.875383:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c02434a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480785.875394:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c02434a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480785.875431:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c02434a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480785.875439:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c02434a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480785.875446:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c02434a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480785.875464:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480785.875468:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c02434a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480785.875475:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c02434a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480785.875487:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:2.0:1782480785.875489:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782480785.875493:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c02434a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480785.875499:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c02434a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480785.875576:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+26:10572:x1869066291704448:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 276us (5479us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480785.875584:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 134 00000100:00100000:1.0:1782480785.954498:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480785.954616:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291704576 00000100:00100000:3.0:1782480785.954627:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291704576 00000100:00100000:3.0:1782480785.954712:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:3.0:1782480785.954724:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2367:x1869066291704576:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:3.0:1782480785.954743:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480785.954786:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054205aa2/0x3dc3ebf33c024351 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa0d expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782480785.954805:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1782480785.954812:0:8678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a3e7f8e, atime: 0x6a3e7f8e, ctime: 0x6a3e7f8e, blocks: 0xb 00010000:00010000:3.0:1782480785.954831:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=406s v=(0 0) 00010000:00010000:3.0:1782480785.954835:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480785.954845:0:8678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054205aa2/0x3dc3ebf33c024351 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa0d expref: 7 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480785.954863:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000054205aa2/0x3dc3ebf33c024351 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa0d expref: 7 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480785.954876:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ed800, rc 0) 00000100:00100000:3.0:1782480785.954945:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2367:x1869066291704576:12345-192.168.204.51@tcp:101:cat.0 Request processed in 224us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480785.954968:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:3.0:1782480785.957925:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480785.960542:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291704704 00000100:00100000:2.0:1782480785.960557:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291704704 00002000:00100000:2.0:1782480785.960610:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9b6d755d5180 x1869066291704704/t0(0) o3->49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp:541/0 lens 488/0 e 0 to 0 dl 1782480796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782480785.960621:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d755d5180 with x1869066291704704 ext(0->4095) 00002000:00010000:2.0:1782480785.960628:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d755d5180 00000100:00100000:2.0:1782480785.960665:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:2.0:1782480785.960675:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2369:x1869066291704704:12345-192.168.204.51@tcp:3:cat.0 00000100:00100000:2.0:1782480785.960941:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2369:x1869066291704704:12345-192.168.204.51@tcp:3:cat.0 Request processed in 266us (3024us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1782480785.960954:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00002000:00100000:2.0:1782480785.960961:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9b6d755d5180 x1869066291704704/t0(0) o3->49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp:541/0 lens 488/4536 e 0 to 0 dl 1782480796 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782480785.960969:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d755d5180 with x1869066291704704 ext(0->4095) 00002000:00010000:2.0:1782480785.960972:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d755d5180 00010000:00010000:1.0:1782480786.106974:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480786.168025:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311636224:0@lo:400:kworker.0 00000100:00100000:0.0:1782480786.168107:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480786.168166:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ae94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311636736:0@lo:400:kworker.0 00000100:00100000:0.0:1782480786.168192:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480786.168232:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782480786.168238:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311636352:0@lo:400:kworker.0 00000100:00100000:0.0:1782480786.168259:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480786.168294:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311636224 00000100:00100000:0.0:1782480786.168301:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311636224 00000100:00100000:0.0:1782480786.168353:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311636352 00000100:00100000:0.0:1782480786.168356:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311636352 00000100:00100000:0.0:1782480786.168387:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1782480786.168396:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311636224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480786.168463:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311636224:12345-0@lo:400:kworker.0 Request processed in 68us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480786.168471:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1782480786.168489:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1782480786.168496:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311636352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480786.168523:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311636352:12345-0@lo:400:kworker.0 Request processed in 29us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480786.168530:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:0.0:1782480786.168549:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480786.168579:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311636352:0@lo:400:kworker.0 00000100:00100000:0.0:1782480786.168591:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311636224:0@lo:400:kworker.0 00000100:00100000:3.0:1782480786.168934:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311636096:0@lo:400:kworker.0 00000100:00100000:3.0:1782480786.168972:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480786.169007:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311636608:0@lo:400:kworker.0 00000100:00100000:3.0:1782480786.169030:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480786.169051:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782480786.169069:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311636480:0@lo:400:kworker.0 00000100:00100000:3.0:1782480786.169095:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480786.169126:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311636736 00000100:00100000:3.0:1782480786.169130:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311636736 00000100:00100000:3.0:1782480786.169169:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311636480 00000100:00100000:3.0:1782480786.169172:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311636480 00000100:00100000:3.0:1782480786.169191:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782480786.169211:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75578a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1869066311636736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480786.169261:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75578a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1869066311636736:12345-0@lo:400:kworker.0 Request processed in 52us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480786.169268:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1782480786.169282:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1782480786.169288:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311636480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480786.169319:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311636480:12345-0@lo:400:kworker.0 Request processed in 32us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480786.169325:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1782480786.169344:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311636608 00000100:00100000:3.0:1782480786.169348:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311636608 00000100:00100000:3.0:1782480786.169369:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1782480786.169386:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869066311636608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480786.169432:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869066311636608:12345-0@lo:400:kworker.0 Request processed in 47us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480786.169438:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1782480786.169458:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782480786.169462:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782480786.169464:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782480786.169482:0:3318:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1782480786.169487:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:3.0:1782480786.169504:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d7fc10e00, transno 4294967301 00000004:00080000:3.0:1782480786.169512:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1782480786.169521:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d755d8000, transno 4294967304 00000100:00100000:3.0:1782480786.169526:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311636480:0@lo:400:kworker.0 00000100:00100000:3.0:1782480786.169539:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311636608:0@lo:400:kworker.0 00000100:00100000:3.0:1782480786.169563:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ae94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311636736:0@lo:400:kworker.0 00000100:00100000:0.0:1782480786.169866:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311636096 00000100:00100000:0.0:1782480786.169871:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311636096 00000100:00100000:0.0:1782480786.169906:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1782480786.169914:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d68bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3318:x1869066311636096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480786.169958:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d68bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3318:x1869066311636096:12345-0@lo:400:kworker.0 Request processed in 45us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480786.169966:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1782480786.170215:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311636096:0@lo:400:kworker.0 00000100:00100000:3.0:1782480786.679086:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480786.679109:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311636864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480786.679168:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480786.679424:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311636864 00000100:00100000:1.0:1782480786.679433:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311636864 00000100:00100000:1.0:1782480786.679498:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782480786.679509:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869066311636864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480786.679547:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480786.679603:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1869066311636864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480786.679610:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782480786.679718:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311636864:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782480787.127871:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782480787.787820:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:2.0:1782480787.787952:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1782480787.788722:0:5829:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b6d75626180 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1782480787.788729:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9b6d68c59600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d75626cc0 00000020:00080000:2.0:1782480787.788733:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9b6d68c59000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d76089c00 00000020:00080000:0.0:1782480787.788774:0:5841:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:0.0:1782480787.788985:0:5841:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1782480787.789108:0:5829:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:0.0:1782480788.150954:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480788.216011:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311636992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480788.216095:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480788.216216:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311636992 00000100:00100000:0.0:1782480788.216230:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311636992 00000100:00100000:0.0:1782480788.216380:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782480788.216391:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4737a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311636992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782480788.216424:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1782480788.216489:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480788.224810:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4737a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311636992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8412us (8705us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480788.224826:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782480788.226160:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311636992:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1782480788.351090:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1782480788.351106:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:1.0:1782480788.571328:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480788.571397:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480788.571404:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291704832 00000100:00100000:3.0:1782480788.571427:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291704832 00000100:00100000:1.0:1782480788.571437:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480788.571461:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480788.571483:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 290 00000100:00100000:3.0:1782480788.571500:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d68bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2368:x1869066291704832:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480788.571501:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480788.571545:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291705344 00000100:00100000:1.0:1782480788.571550:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291705344 00000100:00100000:3.0:1782480788.571598:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d68bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2368:x1869066291704832:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 105us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480788.571601:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291704960 00000100:00100000:1.0:1782480788.571606:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291704960 00000100:00100000:3.0:1782480788.571611:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 290 00000100:00100000:1.0:1782480788.571632:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 141 00000100:00100000:1.0:1782480788.571640:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2368:x1869066291705344:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480788.571677:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2368:x1869066291705344:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 38us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480788.571684:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 141 00000100:00100000:1.0:1782480788.571700:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 142 00000100:00100000:1.0:1782480788.571706:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+13:2368:x1869066291704960:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480788.571728:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+13:2368:x1869066291704960:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 22us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480788.571734:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 142 00000100:00080000:1.0:1782480788.571797:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480788.571811:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291705088 00000100:00100000:1.0:1782480788.571815:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291705088 00000100:00100000:1.0:1782480788.571852:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291705216 00000100:00100000:1.0:1782480788.571856:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291705216 00000100:00100000:1.0:1782480788.571881:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:1.0:1782480788.571889:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2368:x1869066291705088:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480788.571927:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:1.0:1782480788.571934:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2368:x1869066291705088:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 45us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480788.571941:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2368:x1869066291705216:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480788.571947:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00080000:1.0:1782480788.571968:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782480788.571971:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480788.571978:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2368:x1869066291705216:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 41us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480788.571987:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 78 00010000:00010000:1.0:1782480789.177830:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480790.198967:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782480791.095207:0:11541:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480791.095215:0:11541:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480791.095584:0:11541:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1782480791.095592:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1782480791.222919:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480791.286946:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480791.286977:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311637120:0@lo:400:kworker.0 00000100:00100000:1.0:1782480791.287018:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311637248:0@lo:400:kworker.0 00000100:00100000:2.0:1782480791.287093:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311637632:0@lo:400:kworker.0 00000100:00100000:0.0:1782480791.287097:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480791.287102:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480791.287178:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480791.287226:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311637760:0@lo:400:kworker.0 00000100:00100000:0.0:1782480791.287234:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311637504:0@lo:400:kworker.0 00000100:00100000:2.0:1782480791.287272:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311637248 00000100:00100000:1.0:1782480791.287282:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480791.287283:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311637248 00000100:00100000:0.0:1782480791.287294:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1869066311637376:0@lo:400:kworker.0 00000100:00100000:2.0:1782480791.287374:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311637632 00000100:00100000:2.0:1782480791.287379:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311637632 00000100:00100000:0.0:1782480791.287386:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480791.287428:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311637376 00000100:00100000:1.0:1782480791.287436:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311637376 00000100:00100000:2.0:1782480791.287445:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1782480791.287451:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311637120 00000100:00100000:2.0:1782480791.287459:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311637248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480791.287470:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311637120 00000100:00100000:1.0:1782480791.287492:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1782480791.287504:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869066311637632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480791.287556:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1782480791.287557:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311637248:12345-0@lo:400:kworker.0 Request processed in 91us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480791.287572:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869066311637632:12345-0@lo:400:kworker.0 Request processed in 70us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480791.287580:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1782480791.287582:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d68bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3317:x1869066311637120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480791.287596:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1782480791.287625:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1782480791.287635:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869066311637376:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782480791.287648:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480791.287664:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d68bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3317:x1869066311637120:12345-0@lo:400:kworker.0 Request processed in 95us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480791.287681:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1782480791.287710:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869066311637376:12345-0@lo:400:kworker.0 Request processed in 73us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480791.287722:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1782480791.287723:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311637632:0@lo:400:kworker.0 00000100:00100000:1.0:1782480791.287790:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311637760 00000100:00100000:1.0:1782480791.287795:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311637760 00000100:00100000:2.0:1782480791.287817:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311637248:0@lo:400:kworker.0 00000100:00080000:2.0:1782480791.287852:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782480791.287855:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1869066311637376:0@lo:400:kworker.0 00000100:00100000:1.0:1782480791.287864:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782480791.287876:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311637760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480791.287897:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480791.287938:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311637760:12345-0@lo:400:kworker.0 Request processed in 61us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480791.287951:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311637120:0@lo:400:kworker.0 00000100:00100000:1.0:1782480791.287952:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782480791.287978:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311637504 00000100:00100000:1.0:1782480791.287984:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311637504 00000100:00100000:1.0:1782480791.288035:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782480791.288043:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311637504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480791.288063:0:3315:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1782480791.288070:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1782480791.288083:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311637504:12345-0@lo:400:kworker.0 Request processed in 41us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480791.288090:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782480791.288095:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311637760:0@lo:400:kworker.0 00000100:00080000:0.0:1782480791.288137:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480791.288177:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311637504:0@lo:400:kworker.0 00000100:00100000:0.0:1782480791.798947:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311637888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480791.799012:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480791.799060:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311637888 00000100:00100000:1.0:1782480791.799068:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311637888 00000100:00100000:1.0:1782480791.799113:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782480791.799121:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311637888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480791.799151:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480791.799190:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311637888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480791.799195:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782480791.799236:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311637888:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782480792.250890:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1782480792.879183:0:5829:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1782480792.879262:0:5841:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1782480792.879276:0:5841:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1782480793.271012:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480793.335649:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311638016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480793.335717:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480793.335927:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311638016 00000100:00100000:3.0:1782480793.335935:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311638016 00000100:00100000:3.0:1782480793.335982:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782480793.335990:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311638016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480793.336021:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480793.336059:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311638016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480793.336065:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782480793.336101:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311638016:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782480793.336124:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480793.412496:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480793.412678:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291705472 00000100:00100000:2.0:1782480793.412688:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291705472 00000100:00100000:2.0:1782480793.412855:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 135 00000100:00100000:2.0:1782480793.412868:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+13:10224:x1869066291705472:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1782480793.412987:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+13:10224:x1869066291705472:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 Request processed in 121us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480793.412995:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 135 00000100:00080000:3.0:1782480793.416360:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480793.423646:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480793.423788:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291705728 00000100:00100000:3.0:1782480793.423799:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291705728 00000100:00100000:3.0:1782480793.423866:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:3.0:1782480793.423891:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+13:10224:x1869066291705728:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782480793.424421:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+14:10224:x1869066291705728:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 530us (783us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1782480793.424430:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:0.0:1782480793.691944:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480793.692131:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480793.692167:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480793.692287:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480793.692337:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291706240 00000100:00100000:0.0:1782480793.692347:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291706240 00000100:00100000:0.0:1782480793.692412:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 146 00000100:00100000:0.0:1782480793.692421:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291706240:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480793.692499:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291706240:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480793.692508:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 146 00000100:00100000:2.0:1782480793.693189:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291705856 00000100:00100000:2.0:1782480793.693197:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291705856 00000100:00100000:2.0:1782480793.693247:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 292 00000100:00100000:2.0:1782480793.693274:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2366:x1869066291705856:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480793.693321:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2366:x1869066291705856:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 57us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480793.693328:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 292 00000100:00080000:0.0:1782480793.693719:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480793.697514:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291706112 00000100:00100000:1.0:1782480793.697530:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291706112 00000100:00100000:1.0:1782480793.697699:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291705984 00000100:00100000:1.0:1782480793.697704:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291705984 00000100:00100000:2.0:1782480793.697782:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00100000:2.0:1782480793.697797:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2366:x1869066291706112:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480793.697881:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2366:x1869066291706112:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 88us (5749us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480793.697903:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00080000:0.0:1782480793.701618:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782480793.701629:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782480793.702552:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:1.0:1782480793.702568:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2366:x1869066291705984:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480793.702673:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2366:x1869066291705984:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 109us (10504us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480793.702680:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:1.0:1782480793.845786:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480793.845899:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291706368 00000100:00100000:0.0:1782480793.845909:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291706368 00000100:00100000:0.0:1782480793.845982:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 136 00000100:00100000:0.0:1782480793.845992:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:11025:x1869066291706368:12345-192.168.204.51@tcp:101:lsof.0 00010000:00010000:0.0:1782480793.846155:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480793.846178:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c024358 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa14 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480793.846243:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c02435f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480793.846257:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c02435f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480793.846352:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c02435f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480793.846737:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782480793.846741:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480793.846870:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c02435f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480793.846909:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c024358 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa14 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480793.846927:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c02435f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa14 expref: 6 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480793.846935:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddce00) 00010000:00010000:0.0:1782480793.846938:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782480793.846942:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2c600, rc 0) 00000100:00100000:0.0:1782480793.847004:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+6:11025:x1869066291706368:12345-192.168.204.51@tcp:101:lsof.0 Request processed in 1013us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480793.847236:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 136 00010000:00010000:0.0:1782480794.295030:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480795.319329:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480796.343034:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480796.407487:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1869066311638400:0@lo:400:kworker.0 00000100:00100000:1.0:1782480796.407565:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480796.407638:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782480796.407645:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311638272:0@lo:400:kworker.0 00000100:00100000:1.0:1782480796.407668:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480796.407684:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311638784:0@lo:400:kworker.0 00000100:00100000:1.0:1782480796.407706:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480796.407738:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311638400 00000100:00100000:1.0:1782480796.407762:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311638400 00000100:00100000:1.0:1782480796.407812:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311638272 00000100:00100000:1.0:1782480796.407816:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311638272 00000100:00100000:1.0:1782480796.407838:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1782480796.407846:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869066311638400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480796.407902:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1869066311638400:12345-0@lo:400:kworker.0 Request processed in 55us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480796.407910:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1782480796.407930:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1782480796.407936:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4604ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311638272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480796.407978:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4604ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311638272:12345-0@lo:400:kworker.0 Request processed in 42us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480796.407983:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1782480796.408016:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480796.408027:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311638784 00000100:00100000:1.0:1782480796.408030:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311638784 00000100:00100000:1.0:1782480796.408057:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1782480796.408063:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311638784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480796.408091:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311638784:12345-0@lo:400:kworker.0 Request processed in 28us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480796.408096:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1782480796.408108:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782480796.408133:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311638272:0@lo:400:kworker.0 00000100:00100000:1.0:1782480796.408142:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311638784:0@lo:400:kworker.0 00000100:00100000:1.0:1782480796.408150:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3316:1869066311638400:0@lo:400:kworker.0 00000100:00100000:3.0:1782480796.409910:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311638528:0@lo:400:kworker.0 00000100:00100000:3.0:1782480796.409970:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480796.410034:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782480796.410040:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311638144:0@lo:400:kworker.0 00000100:00100000:3.0:1782480796.410067:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480796.410098:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311638656:0@lo:400:kworker.0 00000100:00100000:3.0:1782480796.410121:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480796.410155:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311638528 00000100:00100000:3.0:1782480796.410161:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311638528 00000100:00080000:3.0:1782480796.410185:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480796.410230:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782480796.410238:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311638528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480796.410296:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311638528:12345-0@lo:400:kworker.0 Request processed in 58us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480796.410301:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782480796.410337:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311638528:0@lo:400:kworker.0 00000100:00100000:0.0:1782480796.410473:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311638144 00000100:00100000:0.0:1782480796.410478:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311638144 00000100:00100000:0.0:1782480796.410524:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1782480796.410532:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3317:x1869066311638144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480796.410573:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3317:x1869066311638144:12345-0@lo:400:kworker.0 Request processed in 43us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480796.410579:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1782480796.410615:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7fffafe6-aedd-4500-93d4-974eea0c11af:3317:1869066311638144:0@lo:400:kworker.0 00000100:00100000:0.0:1782480796.410635:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311638656 00000100:00100000:0.0:1782480796.410638:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311638656 00000100:00100000:0.0:1782480796.410672:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1782480796.410678:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311638656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480796.410713:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311638656:12345-0@lo:400:kworker.0 Request processed in 34us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480796.410719:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:0.0:1782480796.410733:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480796.410784:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311638656:0@lo:400:kworker.0 00000100:00100000:0.0:1782480796.919052:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782480796.919074:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311638912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480796.919142:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480796.919286:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311638912 00000100:00100000:3.0:1782480796.919295:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311638912 00000100:00100000:3.0:1782480796.919353:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782480796.919363:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311638912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782480796.919400:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480796.919468:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311638912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480796.919476:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782480796.920395:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311638912:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782480797.375985:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782480798.006385:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000001:02000400:3.0:1782480798.330743:0:12168:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 09:33:17 (1782480797) 00010000:00010000:2.0:1782480798.395530:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480798.454974:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782480798.454999:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311639040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480798.455074:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480798.455594:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311639040 00000100:00100000:2.0:1782480798.455602:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311639040 00000100:00100000:2.0:1782480798.455665:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782480798.455676:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7519a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311639040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782480798.455712:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480798.455783:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7519a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311639040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480798.455790:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782480798.456006:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311639040:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782480798.456070:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480798.810242:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480798.810280:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480798.810324:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480798.810457:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291706496 00000100:00100000:0.0:1782480798.810469:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291706496 00000100:00100000:0.0:1782480798.810538:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 294 00000100:00100000:0.0:1782480798.810547:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2369:x1869066291706496:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480798.810578:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291706752 00000100:00100000:1.0:1782480798.810582:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291706752 00000100:00100000:0.0:1782480798.810620:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2369:x1869066291706496:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 73us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480798.810628:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 294 00000100:00100000:1.0:1782480798.810629:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:1.0:1782480798.810635:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2369:x1869066291706752:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480798.810666:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2369:x1869066291706752:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 31us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480798.810672:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00080000:0.0:1782480798.810681:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480798.811387:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480798.812722:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480798.813099:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291707008 00000100:00100000:2.0:1782480798.813107:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291707008 00000100:00100000:2.0:1782480798.813176:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291706624 00000100:00100000:2.0:1782480798.813180:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291706624 00000100:00100000:2.0:1782480798.813206:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 150 00000100:00100000:2.0:1782480798.813214:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:210e3ff4-fa06-469c-afa9-3e2abcd77331+6:2369:x1869066291707008:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480798.813280:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:210e3ff4-fa06-469c-afa9-3e2abcd77331+6:2369:x1869066291707008:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 67us (2964us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480798.813287:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 150 00000100:00100000:2.0:1782480798.813301:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 151 00000100:00100000:2.0:1782480798.813307:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+13:2369:x1869066291706624:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480798.813346:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+13:2369:x1869066291706624:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 39us (1963us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480798.813352:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 151 00000100:00080000:3.0:1782480798.813587:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480798.814450:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291706880 00000100:00100000:0.0:1782480798.814460:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291706880 00000100:00100000:2.0:1782480798.814742:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:2.0:1782480798.814781:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2369:x1869066291706880:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480798.814848:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2369:x1869066291706880:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 70us (2131us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480798.814863:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00080000:3.0:1782480798.815637:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782480799.416740:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480799.969427:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480799.969741:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291707264 00000100:00100000:0.0:1782480799.969784:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291707264 00000100:00100000:0.0:1782480799.969868:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 137 00000100:00100000:0.0:1782480799.969880:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+13:11290:x1869066291707264:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782480799.969903:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480799.969924:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c024366 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa1b expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.970014:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c02436d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.970040:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c02436d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.970053:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c02436d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.970068:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024374 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.970077:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024374 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.970096:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024374 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.970607:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02437b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.970618:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02437b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.970626:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02437b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480799.970635:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1782480799.970883:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c02436d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.970891:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c02436d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.970898:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c02436d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.970906:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2ca00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480799.970911:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c02436d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.970919:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c02436d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.970930:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b6d45d62c00) 00010000:00010000:0.0:1782480799.970933:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480799.970944:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c02436d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.970950:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c02436d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.970964:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024374 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.970970:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024374 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.970976:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024374 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.970981:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480799.970984:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024374 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.970990:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024374 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.970998:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b6d43255700) 00010000:00010000:0.0:1782480799.971001:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480799.971003:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024374 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.971009:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024374 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.971398:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c024366 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa1b expref: 16 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.971426:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02437b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa1b expref: 15 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480799.971435:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d4bddc700) 00010000:00010000:0.0:1782480799.971438:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480799.971441:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2cc00, rc 0) 00000100:00100000:0.0:1782480799.971531:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+15:11290:x1869066291707264:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1653us (2127us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1782480799.971540:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 137 00000100:00100000:0.0:1782480799.981684:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480799.981733:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480799.981839:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291707520 00000100:00100000:2.0:1782480799.981849:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291707520 00000100:00100000:2.0:1782480799.981918:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:2.0:1782480799.981928:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+15:2368:x1869066291707520:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480799.981953:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480799.981977:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02437b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa1b expref: 15 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480799.981997:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d4bddc700) 00010000:00010000:2.0:1782480799.982002:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480799.982063:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+14:2368:x1869066291707520:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 136us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480799.982070:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:3.0:1782480799.982415:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291707392 00000100:00100000:3.0:1782480799.982420:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291707392 00000100:00100000:3.0:1782480799.982470:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 138 00000100:00100000:3.0:1782480799.982478:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+14:11290:x1869066291707392:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1782480799.982566:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+14:11290:x1869066291707392:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 Request processed in 89us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480799.982574:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 138 00000040:00080000:0.0:1782480800.311050:0:11541:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480800.311060:0:11541:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480800.311968:0:11541:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1782480800.311983:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1782480800.444798:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782480801.335068:0:11541:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480801.335086:0:11541:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480801.335565:0:11541:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1782480801.335573:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1782480801.463070:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480801.531072:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311639168:0@lo:400:kworker.0 00000100:00100000:3.0:1782480801.531175:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480801.531285:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311639168 00000100:00100000:1.0:1782480801.531294:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311639168 00000100:00100000:1.0:1782480801.531347:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1782480801.531356:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3318:x1869066311639168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480801.537207:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3318:x1869066311639168:12345-0@lo:400:kworker.0 Request processed in 5841us (6022us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480801.537229:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1782480801.539408:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311639552:0@lo:400:kworker.0 00000100:00100000:2.0:1782480801.539485:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480801.539557:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782480801.539564:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311639680:0@lo:400:kworker.0 00000100:00100000:2.0:1782480801.539590:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480801.539626:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311639296:0@lo:400:kworker.0 00000100:00100000:2.0:1782480801.539652:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480801.539671:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311639808:0@lo:400:kworker.0 00000100:00100000:2.0:1782480801.539692:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480801.539714:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782480801.539720:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311639424:0@lo:400:kworker.0 00000100:00100000:2.0:1782480801.539740:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480801.539790:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311639680 00000100:00100000:2.0:1782480801.539798:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311639680 00000100:00100000:2.0:1782480801.539863:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311639296 00000100:00100000:2.0:1782480801.539866:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311639296 00000100:00100000:2.0:1782480801.539884:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311639424 00000100:00100000:2.0:1782480801.539886:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311639424 00000100:00100000:2.0:1782480801.539903:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782480801.539911:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311639680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480801.539962:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311639680:12345-0@lo:400:kworker.0 Request processed in 52us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480801.539970:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782480801.539986:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782480801.539992:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311639296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480801.540022:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311639296:12345-0@lo:400:kworker.0 Request processed in 30us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480801.540026:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782480801.540093:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782480801.540126:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311639424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480801.540170:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311639424:12345-0@lo:400:kworker.0 Request processed in 62us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480801.540175:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782480801.540200:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311639552 00000100:00100000:2.0:1782480801.540204:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311639552 00000100:00100000:2.0:1782480801.540229:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311639808 00000100:00100000:2.0:1782480801.540232:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311639808 00000100:00100000:2.0:1782480801.540250:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782480801.540255:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311639552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480801.540285:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311639552:12345-0@lo:400:kworker.0 Request processed in 30us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480801.540291:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782480801.540300:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1782480801.540307:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311639808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480801.540331:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311639808:12345-0@lo:400:kworker.0 Request processed in 25us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480801.540336:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1782480801.540382:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311639424:0@lo:400:kworker.0 00000100:00100000:2.0:1782480801.540393:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311639296:0@lo:400:kworker.0 00000100:00100000:2.0:1782480801.540400:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311639808:0@lo:400:kworker.0 00000100:00100000:2.0:1782480801.540432:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311639680:0@lo:400:kworker.0 00000100:00100000:2.0:1782480801.540442:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311639552:0@lo:400:kworker.0 00000100:00100000:3.0:1782480801.541234:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311639168:0@lo:400:kworker.0 00000100:00080000:3.0:1782480801.541261:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782480801.541265:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782480801.541282:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480802.039176:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311639936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480802.039250:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480802.039617:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311639936 00000100:00100000:2.0:1782480802.039633:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311639936 00000100:00100000:2.0:1782480802.039700:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782480802.039710:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4604a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311639936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782480802.039772:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480802.039836:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4604a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311639936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480802.039844:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782480802.040068:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311639936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480802.157082:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480802.159281:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291707648 00000100:00100000:2.0:1782480802.159296:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291707648 00000100:00100000:2.0:1782480802.159384:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 139 00000100:00100000:2.0:1782480802.159396:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+14:11333:x1869066291707648:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1782480802.159416:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480802.159439:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024389 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa22 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.159514:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024390 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.159529:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024390 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.159538:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024390 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.159553:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024397 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.159560:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024397 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.159575:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024397 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782480802.159714:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782480802.160115:0:11544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024390 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.160124:0:11544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024390 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.160131:0:11544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024390 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.160137:0:11544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480802.160141:0:11544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024390 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.160149:0:11544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024390 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.160161:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddce00) 00010000:00010000:2.0:1782480802.160164:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480802.160169:0:11544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024390 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.160176:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024390 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.160188:0:11544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024397 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.160195:0:11544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024397 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.160206:0:11544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024397 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.160212:0:11544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480802.160215:0:11544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024397 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.160221:0:11544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024397 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.160228:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b6d45d62300) 00010000:00010000:2.0:1782480802.160230:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480802.160233:0:11544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024397 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.160239:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024397 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.160269:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024389 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa22 expref: 15 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.160280:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddce00) 00010000:00010000:2.0:1782480802.160282:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480802.160285:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024389 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa22 expref: 15 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.160294:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e8800, rc 0) 00000100:00100000:2.0:1782480802.160401:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+14:11333:x1869066291707648:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1006us (3327us total) trans 0 rc 301/301 00000100:00100000:2.0:1782480802.160417:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 139 00000100:00100000:2.0:1782480802.181109:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480802.181163:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291707904 00000100:00100000:2.0:1782480802.181174:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291707904 00000100:00100000:2.0:1782480802.181250:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 140 00000100:00100000:2.0:1782480802.181263:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+14:11333:x1869066291707904:12345-192.168.204.51@tcp:36:lfs.0 00010000:00010000:2.0:1782480802.181339:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480802.182493:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c023d07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f85b expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.182516:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddce00) 00010000:00010000:2.0:1782480802.182522:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782480802.183025:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02439e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.183042:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c02435f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa14 expref: 5 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.183051:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02439e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.183089:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c02435f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa14 expref: 5 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.183118:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c02435f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa14 expref: 5 pid: 5809 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480802.183135:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f06680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1869066311640064:192.168.204.51@tcp:104: 00000100:00100000:2.0:1782480802.183241:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51139f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782480802.198182:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480802.198249:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291708032 00000100:00100000:2.0:1782480802.198258:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291708032 00010000:00010000:2.0:1782480802.198314:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c02435f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa14 expref: 6 pid: 5809 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480802.198351:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:2.0:1782480802.198362:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+6:2367:x1869066291708032:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480802.198377:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480802.198385:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c02435f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa14 expref: 6 pid: 5809 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.198398:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c02435f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa14 expref: 6 pid: 5809 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.198422:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddce00) 00010000:00010000:2.0:1782480802.198427:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02439e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.198436:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02439e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.198443:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02439e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.198460:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480802.198521:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+6:2367:x1869066291708032:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 160us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480802.198530:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00010000:00010000:2.0:1782480802.198655:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c02435f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa14 expref: 5 pid: 5809 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480802.198672:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f06680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1869066311640064:192.168.204.51@tcp:104: 00010000:00010000:2.0:1782480802.198690:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02439e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.198700:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02439e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.198706:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02439e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.198727:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0243a5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.198736:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0243a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.198766:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0243a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782480802.199587:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1782480802.203176:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1782480802.203196:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02439e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.203206:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02439e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.203213:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02439e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.203231:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480802.203236:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02439e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.203243:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02439e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.203259:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d4bddce00) 00010000:00010000:2.0:1782480802.203262:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480802.203267:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02439e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.203274:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02439e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480802.203292:0:5807:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004ca20ca1 reply state 0000000089a5a11a transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0243a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480802.203302:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782480802.203618:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+15:11333:x1869066291707904:12345-192.168.204.51@tcp:36:lfs.0 Request processed in 22355us (22525us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1782480802.203627:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 140 00010000:00010000:0.0:1782480802.223796:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0243a5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.223831:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0243a5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.223838:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0243a5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.223845:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8a00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480802.223849:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0243a5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.223857:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0243a5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.223873:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b6d45d62300) 00010000:00010000:0.0:1782480802.223877:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480802.223881:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0243a5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.223888:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0243a5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480802.365648:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480802.366163:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291708160 00000100:00100000:0.0:1782480802.366175:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291708160 00000100:00100000:0.0:1782480802.366247:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 141 00000100:00100000:0.0:1782480802.366259:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+14:11341:x1869066291708160:12345-192.168.204.51@tcp:101:lctl.0 00010000:00010000:0.0:1782480802.366283:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480802.366308:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c0243ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa29 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.366396:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d200/0x3dc3ebf33c0243b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.366411:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d200/0x3dc3ebf33c0243b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.366423:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d200/0x3dc3ebf33c0243b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480802.366501:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782480802.366506:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480802.366536:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d200/0x3dc3ebf33c0243b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.366562:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c0243ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa29 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.366581:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d200/0x3dc3ebf33c0243b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa29 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.366591:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d43255700) 00010000:00010000:0.0:1782480802.366595:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782480802.366599:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2d200, rc 0) 00000100:00100000:0.0:1782480802.366670:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+15:11341:x1869066291708160:12345-192.168.204.51@tcp:101:lctl.0 Request processed in 413us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480802.366678:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 141 00000100:00100000:2.0:1782480802.426383:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480802.426579:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291708288 00000100:00100000:0.0:1782480802.426593:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291708288 00000100:00100000:0.0:1782480802.426676:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 142 00000100:00100000:0.0:1782480802.426686:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+15:11347:x1869066291708288:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1782480802.426708:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480802.426728:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c0243ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa30 expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.426855:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c0243c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.426871:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c0243c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.426882:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c0243c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.426898:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0243c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.426905:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0243c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.426983:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0243c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.427230:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c0243cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.427239:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c0243cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.427261:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c0243cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480802.427294:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1782480802.427298:0:10450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782480802.427321:0:10450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c0243cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.427334:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c0243c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.427340:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c0243c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.427346:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c0243c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.427352:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480802.427356:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c0243c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.427363:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c0243c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.427383:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d43255700) 00010000:00010000:1.0:1782480802.427386:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480802.427391:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c0243c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.427398:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c0243c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.427413:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0243c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.427420:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0243c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.427425:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0243c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.427431:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c600 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480802.427434:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0243c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.427439:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0243c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.427447:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b6d43255b00) 00010000:00010000:1.0:1782480802.427450:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480802.427452:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0243c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.427458:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0243c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.427501:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c0243ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa30 expref: 17 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.427528:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c0243cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa30 expref: 16 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.427536:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:1.0:1782480802.427538:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782480802.427541:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572800, rc 0) 00000100:00100000:1.0:1782480802.427616:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+16:11347:x1869066291708288:12345-192.168.204.51@tcp:101:bash.0 Request processed in 930us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480802.427624:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 142 00000100:00100000:3.0:1782480802.436877:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480802.437073:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291708544 00000100:00100000:2.0:1782480802.437088:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291708544 00000100:00100000:2.0:1782480802.437179:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 143 00000100:00100000:2.0:1782480802.437190:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+16:11347:x1869066291708544:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1782480802.437215:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480802.437239:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0243d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa37 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.437421:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0243dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.437440:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0243dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.437454:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0243dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.437535:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0243e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.437544:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0243e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.437552:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0243e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782480802.438173:0:5807:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1782480802.438344:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0243eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.438354:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0243eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.438362:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0243eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.438398:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0243dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.438416:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0243dd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.438422:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0243dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.438428:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480802.438433:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0243dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.438441:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0243dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.438455:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:2.0:1782480802.438459:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480802.438464:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0243dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.438471:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0243dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480802.438485:0:5807:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e6170825 reply state 000000001c970561 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0243e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480802.438496:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782480802.438529:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0243d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa37 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.438543:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0243eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa37 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.438562:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62900) 00010000:00010000:2.0:1782480802.438565:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782480802.438567:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9200, rc 0) 00000100:00100000:2.0:1782480802.438650:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+19:11347:x1869066291708544:12345-192.168.204.51@tcp:101:bash.0 Request processed in 1462us (1783us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1782480802.438658:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 143 00010000:00010000:1.0:1782480802.440303:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0243e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.440321:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0243e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.440329:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0243e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.440335:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480802.440340:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0243e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.440349:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0243e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.440363:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d45d62800) 00010000:00010000:1.0:1782480802.440378:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480802.440382:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0243e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.440388:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0243e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480802.443729:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480802.443986:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291708672 00000100:00100000:2.0:1782480802.443996:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291708672 00000100:00100000:2.0:1782480802.444071:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:2.0:1782480802.444082:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2369:x1869066291708672:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1782480802.444111:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480802.444136:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c0243f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa3e expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782480802.444167:0:8678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480802.444191:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=423s v=(0 0) 00010000:00010000:2.0:1782480802.444196:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480802.444206:0:8678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c0243f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa3e expref: 6 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.444228:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c0243f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa3e expref: 6 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.444242:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e8800, rc 0) 00000100:00100000:2.0:1782480802.444314:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2369:x1869066291708672:12345-192.168.204.51@tcp:101:bash.0 Request processed in 233us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480802.444335:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00080000:0.0:1782480802.444587:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480802.448020:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480802.448144:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291708800 00000100:00100000:1.0:1782480802.448156:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291708800 00000100:00100000:1.0:1782480802.448259:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:1.0:1782480802.448269:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:11347:x1869066291708800:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1782480802.448289:0:6604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480802.448307:0:6604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000935a97fb/0x3dc3ebf33c024400 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa45 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.448341:0:6604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c0243f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa3e expref: 7 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.448350:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480802.448354:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480802.448359:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000935a97fb/0x3dc3ebf33c024400 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa45 expref: 7 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.448397:0:6604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c0243f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa3e expref: 7 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.448410:0:6604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c0243f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa3e expref: 7 pid: 8678 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480802.448450:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b333100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6604:1869066311640192:192.168.204.51@tcp:104: 00000100:00100000:1.0:1782480802.448570:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45f4dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480802.454952:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480802.455025:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291708928 00000100:00100000:0.0:1782480802.455034:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291708928 00010000:00010000:0.0:1782480802.455075:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c0243f9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa3e expref: 8 pid: 8678 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480802.455115:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b333100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6604:1869066311640192:192.168.204.51@tcp:104: 00000100:00100000:0.0:1782480802.455120:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:0.0:1782480802.455141:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b330a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2366:x1869066291708928:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480802.455146:0:6604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000935a97fb/0x3dc3ebf33c024400 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa45 expref: 8 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.455155:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480802.455162:0:6604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572400, rc 0) 00010000:00010000:0.0:1782480802.455177:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c0243f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa3e expref: 8 pid: 8678 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.455189:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c0243f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa3e expref: 8 pid: 8678 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.455212:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c0243f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa3e expref: 8 pid: 8678 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480802.455216:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+8:11347:x1869066291708800:12345-192.168.204.51@tcp:101:bash.0 Request processed in 6949us (7207us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480802.455223:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 48 00010000:00010000:0.0:1782480802.455226:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480802.455230:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480802.455238:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000935a97fb/0x3dc3ebf33c024400 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa45 expref: 6 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.455248:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000935a97fb/0x3dc3ebf33c024400 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa45 expref: 6 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.455280:0:5792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000935a97fb/0x3dc3ebf33c024400 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa45 expref: 6 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480802.455294:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753fa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5792:1869066311640320:192.168.204.51@tcp:105: 00000100:00100000:0.0:1782480802.455343:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d47c78180 going to sleep for 11 seconds 00000100:00100000:0.0:1782480802.460013:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753fa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5792:1869066311640320:192.168.204.51@tcp:105: 00010000:00010000:0.0:1782480802.460058:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480802.460127:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b330a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2366:x1869066291708928:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 4985us (5185us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480802.460139:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:0.0:1782480802.463005:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480802.463339:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291709184 00000100:00100000:3.0:1782480802.463349:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291709184 00000100:00100000:3.0:1782480802.463417:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:3.0:1782480802.463428:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+18:11347:x1869066291709184:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:3.0:1782480802.463905:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+19:11347:x1869066291709184:12345-192.168.204.51@tcp:35:bash.0 Request processed in 478us (910us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1782480802.463914:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00010000:00010000:2.0:1782480802.486999:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480802.565042:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480802.565171:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291709440 00000100:00100000:2.0:1782480802.565182:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291709440 00000100:00100000:2.0:1782480802.565248:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 144 00000100:00100000:2.0:1782480802.565258:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+19:11357:x1869066291709440:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1782480802.565284:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480802.565305:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024407 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa4c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480802.565434:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1782480802.565675:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024407 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa4c expref: 21 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.565691:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d43255700) 00010000:00010000:2.0:1782480802.565694:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782480802.565700:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024407 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa4c expref: 21 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.565715:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9400, rc 0) 00000100:00100000:2.0:1782480802.565832:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+20:11357:x1869066291709440:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 574us (806us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1782480802.565840:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 144 00000100:00100000:1.0:1782480802.569002:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480802.569100:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291709696 00000100:00100000:3.0:1782480802.569111:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291709696 00000100:00100000:3.0:1782480802.569172:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:3.0:1782480802.569183:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+20:11357:x1869066291709696:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1782480802.569449:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+21:11357:x1869066291709696:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 265us (454us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1782480802.569691:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:3.0:1782480802.652942:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480802.654065:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291709824 00000100:00100000:1.0:1782480802.654079:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291709824 00000100:00100000:1.0:1782480802.654170:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 145 00000100:00100000:1.0:1782480802.654182:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+21:11363:x1869066291709824:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1782480802.654211:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480802.654234:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c024415 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa53 expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.654545:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c02441c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.654560:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c02441c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.654570:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c02441c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480802.654629:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1782480802.654633:0:10450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782480802.654797:0:10450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c02441c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.654824:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c024415 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa53 expref: 23 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.654861:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c02441c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa53 expref: 22 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.654870:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:1.0:1782480802.654873:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782480802.654877:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572600, rc 0) 00000100:00100000:1.0:1782480802.655166:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+22:11363:x1869066291709824:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 985us (2233us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480802.655174:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 145 00000100:00100000:1.0:1782480802.678193:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480802.678494:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291710080 00000100:00100000:3.0:1782480802.678503:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291710080 00000100:00100000:3.0:1782480802.678562:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 146 00000100:00100000:3.0:1782480802.678571:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+22:11363:x1869066291710080:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1782480802.678592:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480802.678611:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c024423 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa5a expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.678872:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c02442a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.678896:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c02442a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.678907:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c02442a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480802.678925:0:11544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1782480802.679188:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c024423 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa5a expref: 25 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.679218:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c02442a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa5a expref: 24 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.679227:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62900) 00010000:00010000:3.0:1782480802.679229:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480802.679336:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821edc00, rc 0) 00000100:00100000:3.0:1782480802.679501:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+24:11363:x1869066291710080:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 929us (1316us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1782480802.679510:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 146 00000100:00100000:3.0:1782480802.683545:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480802.683651:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480802.684122:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291710208 00000100:00100000:2.0:1782480802.684134:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291710208 00000100:00100000:2.0:1782480802.684208:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:2.0:1782480802.684219:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+24:2369:x1869066291710208:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480802.684251:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480802.684276:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c02442a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa5a expref: 24 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.684295:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62900) 00010000:00010000:2.0:1782480802.684300:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480802.684357:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+23:2369:x1869066291710208:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 140us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480802.684364:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:0.0:1782480802.684447:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291710464 00000100:00100000:0.0:1782480802.684452:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291710464 00000100:00100000:0.0:1782480802.684502:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 147 00000100:00100000:0.0:1782480802.684511:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+23:11363:x1869066291710464:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1782480802.684536:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480802.684552:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024438 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa61 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.684661:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c02443f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.684675:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c02443f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.684685:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c02443f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480802.684697:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1782480802.684856:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024438 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa61 expref: 26 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.684873:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c02443f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa61 expref: 25 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.684892:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62900) 00010000:00010000:0.0:1782480802.684895:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782480802.684898:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2ca00, rc 0) 00000100:00100000:0.0:1782480802.684932:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+25:11363:x1869066291710464:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 422us (1279us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1782480802.684939:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 147 00000100:00100000:3.0:1782480802.703069:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480802.703152:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291710592 00000100:00100000:2.0:1782480802.703162:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291710592 00000100:00100000:2.0:1782480802.703237:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:2.0:1782480802.703248:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2368:x1869066291710592:12345-192.168.204.51@tcp:1:lfs.0 00010000:00010000:2.0:1782480802.703297:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c02444d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.703319:0:8678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000935a97fb/0x3dc3ebf33c024400 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa45 expref: 6 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.703328:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480802.703332:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782480802.703337:0:8678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c02444d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.703375:0:8678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000935a97fb/0x3dc3ebf33c024400 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa45 expref: 6 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.703410:0:8678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000935a97fb/0x3dc3ebf33c024400 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa45 expref: 6 pid: 6604 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480802.703428:0:8678:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8678:1869066311640448:192.168.204.51@tcp:104: 00000100:00100000:2.0:1782480802.703598:0:8678:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51139f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782480802.712210:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480802.712345:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291710720 00000100:00100000:3.0:1782480802.712363:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291710720 00002000:00100000:3.0:1782480802.712419:0:6609:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9b6d7b331f80 x1869066291710720/t0(0) o4->49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp:558/0 lens 504/0 e 0 to 0 dl 1782480813 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782480802.712430:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d7b331f80 with x1869066291710720 ext(0->12) 00010000:00010000:3.0:1782480802.712440:0:6609:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000935a97fb/0x3dc3ebf33c024400 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa45 expref: 7 pid: 6604 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.712457:0:6609:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000935a97fb/0x3dc3ebf33c024400 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa45 expref: 7 pid: 6604 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782480802.712466:0:6609:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b6d7b331f80 00000100:00100000:3.0:1782480802.712499:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:3.0:1782480802.712508:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2367:x1869066291710720:12345-192.168.204.51@tcp:4:lfs.0 00000100:00100000:2.0:1782480802.713162:0:8678:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8678:1869066311640448:192.168.204.51@tcp:104: 00010000:00010000:2.0:1782480802.713191:0:8678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c02444d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480802.714095:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+9:2367:x1869066291710720:12345-192.168.204.51@tcp:4:lfs.0 Request processed in 1570us (1879us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1782480802.714109:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00002000:00100000:3.0:1782480802.714123:0:6609:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9b6d7b331f80 x1869066291710720/t4294967305(0) o4->49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp:558/0 lens 504/448 e 0 to 0 dl 1782480813 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782480802.714152:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d7b331f80 with x1869066291710720 ext(0->12) 00010000:00010000:3.0:1782480802.714165:0:6609:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000935a97fb/0x3dc3ebf33c024400 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa45 expref: 9 pid: 6604 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.714182:0:6609:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000935a97fb/0x3dc3ebf33c024400 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa45 expref: 9 pid: 6604 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782480802.714191:0:6609:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b6d7b331f80 00000100:00100000:1.0:1782480802.733230:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480802.733533:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291710848 00000100:00100000:0.0:1782480802.733544:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291710848 00010000:00010000:0.0:1782480802.733588:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000935a97fb/0x3dc3ebf33c024400 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa45 expref: 9 pid: 6604 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480802.733633:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:0.0:1782480802.733642:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b330e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+9:2366:x1869066291710848:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480802.733659:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1782480802.733678:0:8304:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1782480802.733681:0:8304:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782480802 00002000:00010000:0.0:1782480802.733683:0:8304:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1782480803 00002000:00010000:0.0:1782480802.733685:0:8304:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1782480802 00010000:00010000:0.0:1782480802.733691:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000935a97fb/0x3dc3ebf33c024400 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa45 expref: 9 pid: 6604 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.733705:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000935a97fb/0x3dc3ebf33c024400 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa45 expref: 9 pid: 6604 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.733728:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000935a97fb/0x3dc3ebf33c024400 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa45 expref: 9 pid: 6604 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.733795:0:8304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782480802.733800:0:8304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782480802.733806:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c02444d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.733817:0:8304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c02444d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.733853:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480802.733898:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b330e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2366:x1869066291710848:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 256us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480802.733905:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 63 00010000:00010000:3.0:1782480802.735556:0:8678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c02444d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.735576:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c02444d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.735612:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c02444d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.735622:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c02444d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.735630:0:8678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c02444d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.735637:0:8678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9400 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:3.0:1782480802.735642:0:8678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c02444d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.735666:0:8678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c02444d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.735684:0:8678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c02444d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.735692:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c02444d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480802.735820:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2368:x1869066291710592:12345-192.168.204.51@tcp:1:lfs.0 Request processed in 32569us (32756us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480802.735830:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:1.0:1782480802.753272:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480802.753386:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291711104 00000100:00100000:3.0:1782480802.753397:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291711104 00000100:00100000:3.0:1782480802.753468:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:3.0:1782480802.753479:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45d54050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+25:11363:x1869066291711104:12345-192.168.204.51@tcp:35:lfs.0 00000004:00010000:3.0:1782480802.753549:0:5810:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c02443f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa61 expref: 25 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782480802.754160:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1782480802.754214:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1782480802.754721:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1782480802.754817:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024454 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.754835:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0243eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa37 expref: 29 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.754843:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024454 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.754968:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0243eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa37 expref: 29 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.754984:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0243eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa37 expref: 29 pid: 5807 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480802.755009:0:5810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5810:1869066311640576:192.168.204.51@tcp:104: 00000100:00100000:0.0:1782480802.755101:0:5810:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d47c78180 going to sleep for 11 seconds 00000100:00100000:1.0:1782480802.759900:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480802.760036:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291711232 00000100:00100000:3.0:1782480802.760046:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291711232 00010000:00010000:3.0:1782480802.760100:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0243eb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa37 expref: 30 pid: 5807 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480802.760133:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:3.0:1782480802.760157:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d465ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+30:2367:x1869066291711232:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480802.760177:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480802.760184:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0243eb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa37 expref: 30 pid: 5807 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.760197:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0243eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa37 expref: 30 pid: 5807 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.760220:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62900) 00010000:00010000:3.0:1782480802.760226:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024454 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.760236:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.760244:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024454 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.760274:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480802.760334:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d465ff850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+30:2367:x1869066291711232:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 177us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480802.760342:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 64 00010000:00010000:0.0:1782480802.763605:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0243eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa37 expref: 29 pid: 5807 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480802.763633:0:5810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5810:1869066311640576:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480802.763660:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.763671:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480802.763677:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782480802.763853:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1782480802.764282:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1782480802.764530:0:5810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1869066311640704:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782480802.764594:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480802.764641:0:5810:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d47c78a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782480802.764899:0:5813:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311640704 00000100:00100000:3.0:1782480802.764907:0:5813:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311640704 00000100:00100000:3.0:1782480802.764963:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782480802.764973:0:5813:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5810:x1869066311640704:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1782480802.765056:0:5813:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5810:x1869066311640704:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 85us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480802.765082:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782480802.765610:0:5810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1869066311640704:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1782480802.766133:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1782480802.766201:0:5810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1869066311640832:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782480802.766245:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480802.766467:0:5810:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d47c78180 going to sleep for 11 seconds 00000100:00100000:3.0:1782480802.766663:0:5813:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311640832 00000100:00100000:3.0:1782480802.766669:0:5813:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311640832 00000100:00100000:3.0:1782480802.766717:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782480802.766726:0:5813:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5810:x1869066311640832:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1782480802.767031:0:5813:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5810:x1869066311640832:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 305us (785us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1782480802.767039:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782480802.767135:0:5810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5810:1869066311640832:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1782480802.767193:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1782480802.767242:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024454 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.767254:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024454 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.767272:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024454 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.767279:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480802.767284:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024454 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.767302:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024454 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.767319:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62900) 00010000:00010000:1.0:1782480802.767322:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1782480802.767327:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024454 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480802.767334:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024454 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782480802.767662:0:5810:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1782480802.767815:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1782480802.767827:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 423609079192ns, next at 424609077374ns, rc = 0 00000001:00080000:1.0:1782480802.767834:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1782480802.768024:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62900) 00010000:00010000:1.0:1782480802.768027:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782480802.768036:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c02443f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa61 expref: 33 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480802.768149:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45d54050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+32:11363:x1869066291711104:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 14671us (14888us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1782480802.768159:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 38 00000020:00080000:1.0:1782480802.768163:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1782480802.770931:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480802.771231:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291711360 00000100:00100000:2.0:1782480802.771245:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291711360 00000100:00100000:2.0:1782480802.771325:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 148 00000100:00100000:2.0:1782480802.771336:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+32:11363:x1869066291711360:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1782480802.771361:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480802.771385:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c02445b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa68 expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.771448:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c02445b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa68 expref: 33 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.771462:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c02445b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa68 expref: 33 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.771481:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:2.0:1782480802.771499:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782480802.771503:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9e00, rc 0) 00000100:00100000:2.0:1782480802.771564:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+33:11363:x1869066291711360:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 229us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480802.771571:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 148 00000100:00100000:3.0:1782480802.775328:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480802.775453:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291711616 00000100:00100000:0.0:1782480802.775476:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291711616 00000100:00100000:0.0:1782480802.775537:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:0.0:1782480802.775548:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+33:11363:x1869066291711616:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1782480802.775843:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+34:11363:x1869066291711616:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 296us (525us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1782480802.775850:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:1.0:1782480802.910866:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480802.910963:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291711872 00000100:00100000:3.0:1782480802.910974:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291711872 00000100:00100000:3.0:1782480802.911034:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 149 00000100:00100000:3.0:1782480802.911044:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+34:11373:x1869066291711872:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1782480802.911071:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480802.911101:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c024462 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa6f expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480802.911209:0:11544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1782480802.911644:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c024462 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa6f expref: 36 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.911661:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d43255700) 00010000:00010000:3.0:1782480802.911665:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782480802.911671:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c024462 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa6f expref: 36 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480802.911687:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ecc00, rc 0) 00000100:00100000:3.0:1782480802.912382:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+35:11373:x1869066291711872:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1327us (1512us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1782480802.912392:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 149 00000100:00100000:3.0:1782480802.915317:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480802.915419:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291712000 00000100:00100000:2.0:1782480802.915429:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291712000 00000100:00100000:2.0:1782480802.915497:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 150 00000100:00100000:2.0:1782480802.915508:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+35:11373:x1869066291712000:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:2.0:1782480802.915596:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024470 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.915615:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024470 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.915627:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024470 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.915655:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024477 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.915662:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.915669:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.915809:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02447e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.915817:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02447e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.915840:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02447e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480802.915900:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02447e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.915913:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024470 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.915920:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024470 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.915926:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024470 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.915932:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480802.915936:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024470 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.915944:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024470 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.915956:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:2.0:1782480802.915959:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480802.915964:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024470 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.915970:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024470 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.915983:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.915995:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024477 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.916001:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024477 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.916006:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480802.916009:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024477 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.916016:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024477 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.916024:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d45d62500) 00010000:00010000:2.0:1782480802.916027:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480802.916029:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024477 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.916035:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024477 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.916051:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02447e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.916057:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02447e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.916062:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02447e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.916066:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480802.916075:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02447e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.916091:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02447e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.916099:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:2.0:1782480802.916101:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480802.916104:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02447e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480802.916109:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02447e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480802.923215:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+35:11373:x1869066291712000:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 7694us (7894us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480802.923230:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 150 00000100:00100000:1.0:1782480802.927396:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480802.927794:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291712256 00000100:00100000:0.0:1782480802.927805:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291712256 00000100:00100000:0.0:1782480802.927855:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:0.0:1782480802.927865:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+35:11373:x1869066291712256:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1782480802.928115:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+36:11373:x1869066291712256:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 250us (728us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1782480802.928123:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:1.0:1782480803.000818:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480803.001152:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291712512 00000100:00100000:0.0:1782480803.001163:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291712512 00000100:00100000:0.0:1782480803.001298:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 151 00000100:00100000:0.0:1782480803.001312:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+36:11376:x1869066291712512:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1782480803.001338:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480803.001483:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c024485 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa76 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.001576:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c02448c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.001591:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c02448c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.001604:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c02448c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.001630:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024493 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.001639:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.001646:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.001818:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c02449a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.001828:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c02449a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.001835:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c02449a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480803.001847:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1782480803.002149:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c02448c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.002157:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c02448c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.002163:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c02448c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.002168:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2de00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480803.002173:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c02448c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.002190:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c02448c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.002203:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:0.0:1782480803.002206:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480803.002212:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c02448c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.002218:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c02448c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.002526:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.002534:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024493 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.002540:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.002546:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2d000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480803.002549:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.002555:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024493 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.002564:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d43255c00) 00010000:00010000:0.0:1782480803.002567:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480803.002570:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024493 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.002588:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024493 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.002640:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c024485 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa76 expref: 39 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.002655:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c02449a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa76 expref: 38 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.002661:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:0.0:1782480803.002664:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782480803.002666:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2da00, rc 0) 00000100:00100000:0.0:1782480803.002733:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+38:11376:x1869066291712512:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1422us (1926us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1782480803.002743:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 151 00000100:00100000:1.0:1782480803.008134:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480803.008502:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291712640 00000100:00100000:2.0:1782480803.008512:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291712640 00000100:00100000:2.0:1782480803.008573:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 152 00000100:00100000:2.0:1782480803.008584:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+38:11376:x1869066291712640:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:2.0:1782480803.008653:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0244a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.008671:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0244a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.008682:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0244a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.008708:0:11544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0244a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.008715:0:11544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0244a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.008740:0:11544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0244a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.009150:0:11544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480803.009155:0:11544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0244a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.009163:0:11544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0244a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.009175:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:2.0:1782480803.009179:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782480803.009183:0:11544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0244a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.009190:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0244a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480803.009271:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+38:11376:x1869066291712640:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 688us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480803.009279:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 152 00000100:00100000:1.0:1782480803.011986:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480803.012125:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291712896 00000100:00100000:0.0:1782480803.012135:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291712896 00000100:00100000:0.0:1782480803.012198:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:0.0:1782480803.012208:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+38:11376:x1869066291712896:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1782480803.012480:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+39:11376:x1869066291712896:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 272us (502us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1782480803.012488:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 41 00000001:00080000:3.0:1782480803.183537:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967436 is committed 00000020:00080000:3.0:1782480803.183564:0:5829:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b6d47c78a80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1782480803.183569:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9b6d7b232200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d47c780c0 00000020:00080000:3.0:1782480803.183573:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9b6d7b232600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d7b35a000 00000004:00080000:3.0:1782480803.183611:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1782480803.183778:0:5841:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1782480803.183970:0:5841:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1782480803.184249:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782480803.184279:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311640960:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782480803.184354:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480803.184569:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311640960 00000100:00100000:2.0:1782480803.184578:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311640960 00000100:00100000:2.0:1782480803.184647:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782480803.184657:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1869066311640960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782480803.184682:0:6605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1782480803.184713:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a3e7fa2, atime: 0x6a3e7fa3, ctime: 0x6a3e7fa2, blocks: 0x1 00010000:00010000:2.0:1782480803.184721:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c0244af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.184776:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=424s v=(0 0) 00010000:00010000:2.0:1782480803.184781:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480803.184787:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c0244af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.184804:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c0244af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.184815:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c0244af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.184821:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c0244af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.184837:0:6605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1782480803.186653:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480803.186961:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3318:x1869066311640960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2300us (2602us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1782480803.186974:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1782480803.187006:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480803.187013:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c0244af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782480803.187144:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d75f06d80/2, rc 0, transno 4294967307 00000100:00100000:1.0:1782480803.187152:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311640960:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1782480803.187227:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8800 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480803.187233:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c0244af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.187334:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c0244af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.187427:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c0244af lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.187435:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030858317/0x3dc3ebf33c0244af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.187455:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480803.187457:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480803.187459:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480803.321858:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480803.321975:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291713152 00000100:00100000:3.0:1782480803.321988:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291713152 00000100:00100000:3.0:1782480803.322065:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 153 00000100:00100000:3.0:1782480803.322087:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+17:11407:x1869066291713152:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:3.0:1782480803.322121:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480803.322146:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c0244b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa7d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.322286:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c0244bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.322303:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c0244bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.322318:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c0244bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480803.322361:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1782480803.322614:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c0244b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa7d expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.322632:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c0244bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa7d expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.322641:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:3.0:1782480803.322643:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480803.322647:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821edc00, rc 0) 00000100:00100000:3.0:1782480803.322717:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+19:11407:x1869066291713152:12345-192.168.204.51@tcp:101:cat.0 Request processed in 643us (870us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1782480803.322726:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 153 00000100:00100000:3.0:1782480803.328057:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480803.328176:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291713280 00000100:00100000:0.0:1782480803.328188:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291713280 00000100:00100000:0.0:1782480803.328259:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:0.0:1782480803.328271:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+19:2367:x1869066291713280:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480803.328301:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480803.328327:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c0244bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa7d expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.328346:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:0.0:1782480803.328352:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480803.328421:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+18:2367:x1869066291713280:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 152us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480803.328429:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:3.0:1782480803.328528:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480803.328735:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291713536 00000100:00100000:0.0:1782480803.328740:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291713536 00000100:00100000:0.0:1782480803.328802:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:0.0:1782480803.328809:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+18:11407:x1869066291713536:12345-192.168.204.51@tcp:35:cat.0 00000100:00100000:0.0:1782480803.329126:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+19:11407:x1869066291713536:12345-192.168.204.51@tcp:35:cat.0 Request processed in 317us (597us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1782480803.329134:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:3.0:1782480803.385084:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480803.385549:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291713792 00000100:00100000:0.0:1782480803.385559:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291713792 00000100:00100000:0.0:1782480803.385625:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 154 00000100:00100000:0.0:1782480803.385636:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+19:11413:x1869066291713792:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:0.0:1782480803.385662:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480803.385665:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782480803.385693:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c02441c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa53 expref: 19 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.385713:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:0.0:1782480803.385731:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480803.385802:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0244cb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa84 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.385918:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0244d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.385934:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c02449a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa76 expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.385944:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0244d2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.385978:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c02449a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa76 expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.385993:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c02449a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa76 expref: 19 pid: 5809 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480803.386008:0:5809:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1869066311641088:192.168.204.51@tcp:104: 00000100:00100000:0.0:1782480803.386130:0:5809:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d47c783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480803.388574:0:5809:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5809:1869066311641088:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480803.388605:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0244d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480803.390000:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480803.390089:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291713920 00000100:00100000:2.0:1782480803.390098:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291713920 00010000:00010000:2.0:1782480803.390142:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c02449a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa76 expref: 20 pid: 5809 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480803.390181:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:2.0:1782480803.390191:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+20:2366:x1869066291713920:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480803.390206:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480803.390213:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c02449a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa76 expref: 20 pid: 5809 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.390226:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c02449a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa76 expref: 20 pid: 5809 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.390270:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c02449a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa76 expref: 20 pid: 5809 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.390288:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:2.0:1782480803.390294:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0244d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.390305:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0244d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.390312:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0244d2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480803.390348:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480803.390406:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+19:2366:x1869066291713920:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 216us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480803.390415:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 65 00010000:00010000:1.0:1782480803.390446:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0244d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480803.390455:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0244d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480803.390476:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1782480803.390630:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0244cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa84 expref: 20 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480803.390647:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0244d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa84 expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480803.390655:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:1.0:1782480803.390657:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782480803.390660:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2d000, rc 0) 00000100:00100000:1.0:1782480803.390686:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+19:11413:x1869066291713792:12345-192.168.204.51@tcp:101:dd.0 Request processed in 5053us (5622us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1782480803.390703:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 154 00000100:00100000:2.0:1782480803.398801:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480803.398895:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291714176 00000100:00100000:0.0:1782480803.398907:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291714176 00000100:00100000:0.0:1782480803.398976:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 155 00000100:00100000:0.0:1782480803.398986:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+19:11413:x1869066291714176:12345-192.168.204.51@tcp:36:dd.0 00010000:00010000:0.0:1782480803.399295:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c0244e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.399312:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c0244e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.399324:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c0244e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782480803.399382:0:11544:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1782480803.399406:0:11544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bbe93d4d reply state 000000001200bfba transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c0244e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480803.399415:0:11544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782480803.400991:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+22:11413:x1869066291714176:12345-192.168.204.51@tcp:36:dd.0 Request processed in 1996us (2190us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1782480803.401004:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 155 00000020:00080000:0.0:1782480803.401013:0:11544:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782480803.419928:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c0244e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.419947:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c0244e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.419955:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c0244e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.419961:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2d400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480803.419965:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c0244e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.419972:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c0244e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.420008:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:0.0:1782480803.420010:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480803.420015:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c0244e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.420021:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c0244e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.512639:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480803.575138:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782480803.575170:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311641216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480803.575596:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480803.575717:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311641216 00000100:00100000:0.0:1782480803.575726:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311641216 00000100:00100000:0.0:1782480803.575805:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782480803.575816:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869066311641216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782480803.575845:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480803.575900:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869066311641216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480803.575907:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782480803.581438:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311641216:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1782480803.715194:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1782480803.715221:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:2.0:1782480803.717737:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480803.718447:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291714304 00000100:00100000:0.0:1782480803.718458:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291714304 00000100:00100000:0.0:1782480803.718531:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 156 00000100:00100000:0.0:1782480803.718540:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+21:11427:x1869066291714304:12345-192.168.204.51@tcp:101:stat.0 00010000:00010000:0.0:1782480803.718564:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480803.718584:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c0244e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa8b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.718647:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c0244ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.718678:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c0244ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.718700:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c0244ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.718716:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c0244f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.718723:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c0244f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.718729:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c0244f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.719106:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0244fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.719119:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0244d2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa84 expref: 22 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.719127:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0244fc lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.719162:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0244d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa84 expref: 22 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.719176:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0244d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa84 expref: 22 pid: 5809 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480803.719202:0:5808:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1869066311641344:192.168.204.51@tcp:104: 00000100:00100000:0.0:1782480803.719324:0:5808:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6c42ca7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782480803.722202:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480803.722349:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291714560 00000100:00100000:2.0:1782480803.722359:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291714560 00000100:00100000:2.0:1782480803.722420:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:2.0:1782480803.722431:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+23:6041:x1869066291714560:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1782480803.722804:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+24:6041:x1869066291714560:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 373us (609us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1782480803.722812:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:0.0:1782480803.723284:0:5808:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1869066311641344:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480803.723361:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0244fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480803.729918:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480803.730813:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291714688 00000100:00100000:0.0:1782480803.730833:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291714688 00010000:00010000:0.0:1782480803.730876:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0244d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa84 expref: 24 pid: 5809 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480803.730925:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:0.0:1782480803.730935:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+24:2369:x1869066291714688:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480803.730951:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480803.730958:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0244d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa84 expref: 24 pid: 5809 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.730970:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0244d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa84 expref: 24 pid: 5809 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.730992:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0244d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa84 expref: 24 pid: 5809 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.731007:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:0.0:1782480803.731012:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0244fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.731036:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0244fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.731044:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0244fc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480803.731087:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782480803.731117:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0244fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.731125:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0244fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480803.731145:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+23:2369:x1869066291714688:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 211us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480803.731152:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 66 00000004:00200000:3.0:1782480803.731175:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1782480803.731179:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480803.731200:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0244fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.731213:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0244fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.731236:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c0244ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.731244:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c0244ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.731252:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c0244ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.731257:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2da00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480803.731262:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c0244ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.731268:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c0244ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.731278:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:3.0:1782480803.731281:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480803.731285:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c0244ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.731291:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c0244ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.731313:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c0244f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.731318:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c0244f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.731323:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c0244f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.731329:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2de00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480803.731332:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c0244f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.731337:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c0244f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.731345:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d43255100) 00010000:00010000:3.0:1782480803.731347:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480803.731350:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c0244f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.731356:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c0244f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.731392:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c0244e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa8b expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.731405:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0244fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa8b expref: 22 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480803.731423:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:3.0:1782480803.731425:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480803.731427:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2c400, rc 0) 00000100:00100000:3.0:1782480803.731453:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+22:11427:x1869066291714304:12345-192.168.204.51@tcp:101:stat.0 Request processed in 12915us (13727us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480803.731461:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 156 00000100:00100000:3.0:1782480803.796091:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480803.796207:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291714944 00000100:00100000:0.0:1782480803.796221:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291714944 00000100:00100000:1.0:1782480803.796376:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 157 00000100:00100000:1.0:1782480803.796386:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+22:11433:x1869066291714944:12345-192.168.204.51@tcp:36:truncate.0 00010000:00010000:1.0:1782480803.796447:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480803.796474:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0244fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa8b expref: 22 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480803.796495:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:1.0:1782480803.796501:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782480803.796728:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024503 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480803.796742:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024503 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480803.796800:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024503 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782480803.796856:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1782480803.796883:0:5809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c87a0986 reply state 00000000d6b22494 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024503 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480803.796892:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782480803.796993:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+24:11433:x1869066291714944:12345-192.168.204.51@tcp:36:truncate.0 Request processed in 607us (910us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1782480803.797016:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 157 00000020:00080000:1.0:1782480803.797021:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782480803.799659:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024503 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480803.799675:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024503 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480803.799680:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024503 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480803.799686:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480803.799692:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024503 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480803.799698:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024503 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480803.799715:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:1.0:1782480803.799718:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480803.799722:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024503 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480803.799727:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024503 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480803.931838:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480803.932136:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291715072 00000100:00100000:0.0:1782480803.932148:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291715072 00000100:00100000:0.0:1782480803.932218:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 296 00000100:00100000:0.0:1782480803.932229:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2367:x1869066291715072:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480803.932332:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2367:x1869066291715072:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 99us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480803.932340:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 296 00000100:00100000:3.0:1782480803.940268:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480803.940320:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480803.940482:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480803.940613:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291715200 00000100:00100000:1.0:1782480803.940625:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291715200 00000100:00100000:1.0:1782480803.940686:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291715328 00000100:00100000:1.0:1782480803.940690:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291715328 00000100:00100000:1.0:1782480803.940731:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 89 00000100:00100000:1.0:1782480803.940742:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2366:x1869066291715200:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480803.940873:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2366:x1869066291715200:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 131us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480803.940883:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 89 00000100:00100000:1.0:1782480803.940903:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 90 00000100:00100000:1.0:1782480803.940909:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2366:x1869066291715328:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480803.940934:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2366:x1869066291715328:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 25us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480803.940941:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 90 00000100:00080000:1.0:1782480803.940956:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782480803.941720:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291715456 00000100:00100000:0.0:1782480803.941727:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291715456 00000100:00100000:0.0:1782480803.941812:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 155 00000100:00100000:0.0:1782480803.941821:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291715456:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480803.941879:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291715456:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 60us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480803.941885:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 155 00000100:00100000:3.0:1782480804.073823:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480804.073984:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291715584 00000100:00100000:0.0:1782480804.074009:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291715584 00000100:00100000:0.0:1782480804.074104:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 158 00000100:00100000:0.0:1782480804.074116:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+23:11447:x1869066291715584:12345-192.168.204.51@tcp:101:stat.0 00010000:00010000:0.0:1782480804.074141:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480804.074160:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c02450a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa92 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.074244:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024511 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.074259:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024511 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.074283:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024511 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.074297:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c024518 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.074305:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c024518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.074312:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c024518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.074812:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02451f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.074823:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02451f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.074830:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02451f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480804.074871:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1782480804.074875:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480804.074896:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02451f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.074908:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02451f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.074916:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024511 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.074921:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024511 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.074928:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024511 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.074933:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480804.074937:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024511 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.074945:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024511 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.074956:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:0.0:1782480804.074959:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480804.074963:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024511 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.074968:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024511 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.075001:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c024518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.075007:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c024518 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.075015:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c024518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.075020:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2d600 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480804.075023:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c024518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.075030:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c024518 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.075038:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d43255c00) 00010000:00010000:0.0:1782480804.075041:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480804.075044:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c024518 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.075051:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c024518 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.075095:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c02450a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa92 expref: 25 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.075115:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02451f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa92 expref: 24 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.075134:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:0.0:1782480804.075137:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782480804.075140:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2cc00, rc 0) 00000100:00080000:1.0:1782480804.075296:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480804.076817:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+24:11447:x1869066291715584:12345-192.168.204.51@tcp:101:stat.0 Request processed in 2696us (2996us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480804.076830:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 158 00000100:00100000:3.0:1782480804.199099:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480804.199214:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291715840 00000100:00100000:2.0:1782480804.199240:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291715840 00000100:00100000:2.0:1782480804.199303:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 159 00000100:00100000:2.0:1782480804.199313:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+24:11457:x1869066291715840:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1782480804.199346:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480804.199370:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024526 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fa99 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480804.199783:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1782480804.199961:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024526 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa99 expref: 26 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480804.199976:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d43255700) 00010000:00010000:2.0:1782480804.199979:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782480804.199985:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024526 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa99 expref: 26 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480804.199998:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9800, rc 0) 00000100:00100000:2.0:1782480804.200073:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+25:11457:x1869066291715840:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 762us (984us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1782480804.200082:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 159 00000100:00100000:3.0:1782480804.204837:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480804.204947:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291716096 00000100:00100000:1.0:1782480804.204957:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291716096 00000100:00100000:1.0:1782480804.205014:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:1.0:1782480804.205024:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45d55050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+25:11457:x1869066291716096:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1782480804.205486:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45d55050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+26:11457:x1869066291716096:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 462us (657us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1782480804.205493:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:3.0:1782480804.263528:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480804.263652:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291716352 00000100:00100000:1.0:1782480804.263662:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291716352 00000100:00100000:1.0:1782480804.263728:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 160 00000100:00100000:1.0:1782480804.263738:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+26:11463:x1869066291716352:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1782480804.263798:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480804.263821:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024534 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3faa0 expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480804.263960:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c02453b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480804.263975:0:10450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02451f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa92 expref: 27 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480804.263984:0:10450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c02453b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480804.264021:0:10450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02451f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa92 expref: 27 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480804.264034:0:10450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02451f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa92 expref: 27 pid: 5808 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480804.264049:0:10450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10450:1869066311641472:192.168.204.51@tcp:104: 00000100:00100000:1.0:1782480804.264154:0:10450:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d751dbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480804.268115:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480804.268206:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291716480 00000100:00100000:0.0:1782480804.268225:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291716480 00010000:00010000:0.0:1782480804.268268:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02451f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa92 expref: 28 pid: 5808 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480804.268308:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:0.0:1782480804.268318:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+28:2367:x1869066291716480:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480804.268342:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480804.268350:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02451f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa92 expref: 28 pid: 5808 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.268363:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02451f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa92 expref: 28 pid: 5808 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.268386:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:0.0:1782480804.268392:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c02453b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.268402:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c02453b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.268429:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c02453b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.268450:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480804.268510:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+28:2367:x1869066291716480:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 193us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480804.268519:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 67 00010000:00010000:1.0:1782480804.269285:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02451f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa92 expref: 27 pid: 5808 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480804.269308:0:10450:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10450:1869066311641472:192.168.204.51@tcp:104: 00010000:00010000:1.0:1782480804.269339:0:10450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c02453b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480804.269349:0:10450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c02453b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480804.269371:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c02453b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480804.269390:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1782480804.269548:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024534 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faa0 expref: 28 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480804.269565:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c02453b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faa0 expref: 27 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480804.269586:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:1.0:1782480804.269589:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782480804.269592:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573200, rc 0) 00000100:00100000:1.0:1782480804.269837:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+27:11463:x1869066291716352:12345-192.168.204.51@tcp:101:bash.0 Request processed in 6099us (6317us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1782480804.269845:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 160 00000100:00100000:3.0:1782480804.273617:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480804.273709:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291716736 00000100:00100000:0.0:1782480804.273721:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291716736 00000100:00100000:0.0:1782480804.273813:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 161 00000100:00100000:0.0:1782480804.273824:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+27:11463:x1869066291716736:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:0.0:1782480804.274349:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024549 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.274367:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.274378:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782480804.274434:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1782480804.274461:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000006c2473a reply state 000000006f3652fb transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480804.274471:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782480804.275526:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+30:11463:x1869066291716736:12345-192.168.204.51@tcp:36:bash.0 Request processed in 1697us (1911us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1782480804.275537:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 161 00000020:00080000:0.0:1782480804.275544:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1782480804.280557:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480804.281170:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291716864 00000100:00100000:2.0:1782480804.281181:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291716864 00000100:00100000:2.0:1782480804.281253:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 162 00000100:00100000:2.0:1782480804.281264:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+30:11463:x1869066291716864:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1782480804.281290:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480804.281311:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024550 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3faa7 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480804.281418:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024557 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480804.281434:0:11544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c02453b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faa0 expref: 31 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480804.281442:0:11544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024549 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480804.281449:0:11544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024557 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480804.281466:0:11544:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480804.281493:0:11544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c02453b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faa0 expref: 31 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480804.281507:0:11544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c02453b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faa0 expref: 31 pid: 10450 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480804.281520:0:11544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f07800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11544:1869066311641600:192.168.204.51@tcp:104: 00000100:00100000:2.0:1782480804.281591:0:11544:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75626300 going to sleep for 11 seconds 00010000:00010000:0.0:1782480804.282066:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024549 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.282076:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024549 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.282082:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024549 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.282088:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2d000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480804.282091:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024549 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.282098:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024549 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.282112:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:0.0:1782480804.282115:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480804.282118:0:3302:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024557 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.282127:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024549 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.282134:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024549 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480804.286849:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480804.287116:0:11544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f07800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11544:1869066311641600:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480804.287144:0:11544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024557 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480804.287272:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291716992 00000100:00100000:3.0:1782480804.287281:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291716992 00010000:00010000:3.0:1782480804.287316:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c02453b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faa0 expref: 31 pid: 10450 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480804.287453:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:3.0:1782480804.287463:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+31:2366:x1869066291716992:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480804.287478:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480804.287501:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c02453b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faa0 expref: 31 pid: 10450 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.287513:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c02453b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faa0 expref: 31 pid: 10450 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.287535:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c02453b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faa0 expref: 31 pid: 10450 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.287550:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:3.0:1782480804.287555:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024557 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.287565:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.287573:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024557 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.287703:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480804.287790:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+30:2366:x1869066291716992:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 328us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480804.287799:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 68 00010000:00010000:0.0:1782480804.292870:0:11544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.292905:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480804.292965:0:11544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1782480804.292971:0:11544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480804.292996:0:11544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.293043:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024550 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faa7 expref: 30 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.293078:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024557 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faa7 expref: 29 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.293088:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:0.0:1782480804.293091:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782480804.293095:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e8200, rc 0) 00000100:00100000:0.0:1782480804.293165:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+29:11463:x1869066291716864:12345-192.168.204.51@tcp:101:bash.0 Request processed in 11902us (12618us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480804.293175:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 162 00000100:00100000:2.0:1782480804.296589:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480804.297300:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291717248 00000100:00100000:1.0:1782480804.297312:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291717248 00000100:00100000:1.0:1782480804.297466:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:1.0:1782480804.297477:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+29:11463:x1869066291717248:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:1.0:1782480804.297798:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+30:11463:x1869066291717248:12345-192.168.204.51@tcp:35:bash.0 Request processed in 321us (1217us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1782480804.297806:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:1.0:1782480804.411936:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480804.412097:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291717504 00000100:00100000:2.0:1782480804.412107:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291717504 00000100:00100000:2.0:1782480804.412172:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 163 00000100:00100000:2.0:1782480804.412197:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+30:11473:x1869066291717504:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1782480804.412223:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480804.412244:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02455e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3faae expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480804.412503:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1782480804.412666:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02455e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faae expref: 32 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480804.412681:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d43255700) 00010000:00010000:2.0:1782480804.412684:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782480804.412689:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02455e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faae expref: 32 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480804.412702:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9200, rc 0) 00000100:00100000:2.0:1782480804.412833:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+31:11473:x1869066291717504:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 638us (907us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1782480804.412841:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 163 00000100:00100000:2.0:1782480804.418563:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480804.418657:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291717632 00000100:00100000:0.0:1782480804.418667:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291717632 00000100:00100000:0.0:1782480804.418736:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 164 00000100:00100000:0.0:1782480804.418794:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+31:11473:x1869066291717632:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:0.0:1782480804.419585:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c02456c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.419604:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c02456c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.419631:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c02456c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.419647:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024573 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.419654:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.419659:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.420273:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02457a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.420285:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02457a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.420292:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02457a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782480804.420335:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02457a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.420347:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c02456c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.420354:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c02456c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.420361:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c02456c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.422319:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480804.422325:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c02456c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.422335:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c02456c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.422353:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:0.0:1782480804.422368:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480804.422374:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c02456c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.422381:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c02456c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.422405:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.422412:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024573 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.422418:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.422424:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2dc00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480804.422427:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.422433:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024573 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.422455:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d43255c00) 00010000:00010000:0.0:1782480804.422458:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480804.422461:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024573 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.422468:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024573 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.422485:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02457a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.422491:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02457a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.422497:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02457a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.422502:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480804.422505:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02457a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.422511:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02457a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.422519:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:0.0:1782480804.422521:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480804.422524:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02457a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.422530:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c02457a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480804.422958:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+31:11473:x1869066291717632:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 4208us (4400us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480804.422968:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 164 00000100:00100000:0.0:1782480804.430488:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480804.430577:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291717888 00000100:00100000:3.0:1782480804.430587:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291717888 00000100:00100000:3.0:1782480804.430820:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:3.0:1782480804.430830:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+31:11473:x1869066291717888:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1782480804.432960:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+32:11473:x1869066291717888:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 2122us (2473us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1782480804.432988:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:1.0:1782480804.488486:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480804.488795:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291718144 00000100:00100000:0.0:1782480804.488805:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291718144 00000100:00100000:0.0:1782480804.488872:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 165 00000100:00100000:0.0:1782480804.488882:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d460b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+32:11476:x1869066291718144:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1782480804.488918:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480804.488940:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c024581 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fab5 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489017:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024588 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489030:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024588 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489041:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024588 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489066:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c02458f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489073:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c02458f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489080:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c02458f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489471:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c024596 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489482:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c024596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489489:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c024596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480804.489500:0:11544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1782480804.489584:0:11544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024588 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489607:0:11544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024588 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489614:0:11544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024588 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489620:0:11544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2dc00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480804.489625:0:11544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024588 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489632:0:11544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024588 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489644:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:0.0:1782480804.489647:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480804.489652:0:11544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024588 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489668:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024588 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489680:0:11544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c02458f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489686:0:11544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c02458f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489692:0:11544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c02458f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489696:0:11544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480804.489699:0:11544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c02458f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489706:0:11544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c02458f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489713:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d43255c00) 00010000:00010000:0.0:1782480804.489716:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480804.489719:0:11544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c02458f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489725:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c02458f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489815:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c024581 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fab5 expref: 35 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489839:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c024596 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fab5 expref: 34 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.489845:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:0.0:1782480804.489847:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782480804.489849:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2c600, rc 0) 00000100:00100000:0.0:1782480804.489905:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d460b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+34:11476:x1869066291718144:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1024us (1428us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1782480804.489912:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 165 00000100:00100000:2.0:1782480804.495906:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480804.496005:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291718272 00000100:00100000:1.0:1782480804.496029:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291718272 00000100:00100000:1.0:1782480804.496098:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 166 00000100:00100000:1.0:1782480804.496108:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+34:11476:x1869066291718272:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:1.0:1782480804.496176:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c0245a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480804.496194:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c0245a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480804.496207:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c0245a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480804.496241:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c0245a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480804.496248:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c0245a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480804.496326:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c0245a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480804.496333:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480804.496338:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c0245a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480804.496346:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c0245a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480804.496358:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:1.0:1782480804.496361:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782480804.496365:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c0245a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480804.496381:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c0245a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480804.496463:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+34:11476:x1869066291718272:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 356us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480804.496471:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 166 00000100:00100000:1.0:1782480804.497819:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480804.498368:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291718400 00000100:00100000:0.0:1782480804.498377:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291718400 00000100:00100000:0.0:1782480804.498441:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:0.0:1782480804.498450:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+34:2366:x1869066291718400:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480804.498467:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480804.498488:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c024596 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fab5 expref: 34 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.498505:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:0.0:1782480804.498510:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480804.498566:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+33:2366:x1869066291718400:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 117us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480804.498574:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:2.0:1782480804.502527:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480804.502953:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291718656 00000100:00100000:1.0:1782480804.502964:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291718656 00000100:00100000:1.0:1782480804.503021:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:1.0:1782480804.503031:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+33:11476:x1869066291718656:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1782480804.503299:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+34:11476:x1869066291718656:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 268us (780us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1782480804.503308:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00010000:00010000:2.0:1782480804.535010:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480804.705717:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480804.709910:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291718912 00000100:00100000:0.0:1782480804.709926:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291718912 00000100:00100000:0.0:1782480804.710009:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 167 00000100:00100000:0.0:1782480804.710034:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+34:11494:x1869066291718912:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:0.0:1782480804.710070:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480804.710091:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0245ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fabc expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.710191:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c0245b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.710205:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c0245b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.710227:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c0245b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480804.710239:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1782480804.710875:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0245ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fabc expref: 37 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.710898:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c0245b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fabc expref: 36 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480804.710908:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:0.0:1782480804.710910:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782480804.710914:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2c800, rc 0) 00000100:00100000:0.0:1782480804.710977:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+36:11494:x1869066291718912:12345-192.168.204.51@tcp:101:cat.0 Request processed in 946us (5271us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1782480804.710985:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 167 00000100:00100000:0.0:1782480804.761585:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480804.762283:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291719040 00000100:00100000:2.0:1782480804.762293:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291719040 00000100:00100000:2.0:1782480804.762361:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 168 00000100:00100000:2.0:1782480804.762372:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+36:11495:x1869066291719040:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1782480804.762398:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480804.762434:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0245c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fac3 expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480804.762499:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0245c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480804.762513:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0245c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480804.762523:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0245c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480804.762727:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1782480804.762731:0:10450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480804.762841:0:10450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0245c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480804.762870:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0245c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fac3 expref: 38 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480804.762886:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0245c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fac3 expref: 37 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480804.762895:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:2.0:1782480804.762898:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782480804.762902:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9400, rc 0) 00000100:00100000:2.0:1782480804.762972:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+37:11495:x1869066291719040:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 601us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480804.762979:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 168 00000100:00100000:1.0:1782480804.777585:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480804.777800:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291719424 00000100:00100000:0.0:1782480804.777823:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291719424 00000100:00100000:0.0:1782480804.777885:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:0.0:1782480804.777896:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+37:11495:x1869066291719424:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1782480804.778218:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+38:11495:x1869066291719424:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 322us (642us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1782480804.778226:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:0.0:1782480804.782688:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480804.782858:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291719552 00000100:00100000:1.0:1782480804.782868:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291719552 00000100:00100000:1.0:1782480804.782936:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:1.0:1782480804.782946:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d465fe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+38:11495:x1869066291719552:12345-192.168.204.51@tcp:103:lfs.0 00010000:00010000:1.0:1782480804.782961:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782480804.782993:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024557 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faa7 expref: 38 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480804.783021:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c0245b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fabc expref: 37 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480804.783072:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c02445b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa68 expref: 36 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480804.783085:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:1.0:1782480804.783098:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480804.783153:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d465fe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+35:11495:x1869066291719552:12345-192.168.204.51@tcp:103:lfs.0 Request processed in 208us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480804.783160:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:1.0:1782480804.785505:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480804.785619:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291719680 00000100:00100000:2.0:1782480804.785644:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291719680 00000100:00100000:2.0:1782480804.785885:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 169 00000100:00100000:2.0:1782480804.785897:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+35:11495:x1869066291719680:12345-192.168.204.51@tcp:58:lfs.0 00010000:00010000:2.0:1782480804.786054:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0245ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480804.786074:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0245ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480804.786088:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0245ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782480804.786790:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1782480804.786882:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+35:11495:x1869066291719680:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 985us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480804.795847:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 169 00000100:00100000:1.0:1782480804.822068:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480804.824112:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291719808 00000100:00100000:2.0:1782480804.824128:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291719808 00000100:00100000:3.0:1782480804.825159:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 170 00000100:00100000:3.0:1782480804.825177:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+35:11497:x1869066291719808:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1782480804.825203:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480804.825226:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c0245d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3faca expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.825311:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0245dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.825325:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0245dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.825892:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0245dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.825915:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c0245e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.825926:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c0245e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.825933:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c0245e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.826517:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0245ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.826528:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0245ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.826545:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0245ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480804.826653:0:11544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1782480804.826658:0:11544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480804.826681:0:11544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0245ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.826693:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0245ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.826702:0:11544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0245dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.826708:0:11544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0245dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.826719:0:11544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0245dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.826726:0:11544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821eda00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480804.826730:0:11544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0245dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.826741:0:11544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0245dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.826777:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:3.0:1782480804.826783:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480804.826788:0:11544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0245dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.826809:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0245dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.826983:0:11544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c0245e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.826993:0:11544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c0245e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.826999:0:11544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c0245e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.827005:0:11544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ec000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480804.827008:0:11544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c0245e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.827017:0:11544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c0245e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.827026:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d4bddc100) 00010000:00010000:3.0:1782480804.827029:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480804.827034:0:11544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c0245e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.827041:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c0245e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.827092:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c0245d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faca expref: 37 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.827124:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0245ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faca expref: 36 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480804.827132:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:3.0:1782480804.827135:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782480804.827137:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ec800, rc 0) 00000100:00100000:3.0:1782480804.827392:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+36:11497:x1869066291719808:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 2220us (5332us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480804.827402:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 170 00000040:00080000:1.0:1782480805.432209:0:11541:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782480805.432220:0:11541:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782480805.432260:0:11541:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1782480805.432269:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782480805.432544:0:11541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755db100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11541:1869066311641728:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782480805.432645:0:11541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46016600 going to sleep for 11 seconds 00000100:00100000:0.0:1782480805.436367:0:11541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755db100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11541:1869066311641728:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782480805.439359:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480805.439464:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291719936 00000100:00100000:3.0:1782480805.439474:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291719936 00000100:00100000:3.0:1782480805.439583:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 171 00000100:00100000:3.0:1782480805.439594:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+36:11508:x1869066291719936:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782480805.439628:0:5809:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782480805.439743:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+36:11508:x1869066291719936:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 150us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480805.439788:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 171 00000100:00100000:1.0:1782480805.450516:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480805.453489:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291720064 00000100:00100000:2.0:1782480805.453506:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291720064 00000100:00100000:2.0:1782480805.457067:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 172 00000100:00100000:2.0:1782480805.457092:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+36:11508:x1869066291720064:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1782480805.457171:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0245f1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457188:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0245f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457201:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0245f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457238:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0245f8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457246:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0245f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457253:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0245f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457281:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0245ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457289:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0245ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457296:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0245ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480805.457336:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1782480805.457340:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480805.457353:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0245ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457365:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0245f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457371:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0245f1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457379:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0245f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457394:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8a00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480805.457399:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0245f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457407:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0245f1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457419:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d4bddc700) 00010000:00010000:2.0:1782480805.457422:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480805.457427:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0245f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457433:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0245f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457447:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0245f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457453:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0245f8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457459:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0245f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457464:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480805.457467:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0245f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457473:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0245f8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457491:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9b6d45d62500) 00010000:00010000:2.0:1782480805.457493:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480805.457496:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0245f8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457503:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0245f8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457518:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0245ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457524:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0245ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457529:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0245ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457535:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480805.457538:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0245ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457544:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0245ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457551:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:2.0:1782480805.457553:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480805.457556:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0245ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.457562:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0245ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480805.457669:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+36:11508:x1869066291720064:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 Request processed in 587us (7163us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480805.457677:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 172 00000100:00100000:1.0:1782480805.461042:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480805.462837:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291720320 00000100:00100000:2.0:1782480805.462851:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291720320 00000100:00100000:2.0:1782480805.462918:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 173 00000100:00100000:2.0:1782480805.462928:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+36:11508:x1869066291720320:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782480805.462951:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480805.462972:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c024606 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fad1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.463080:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02460d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.463094:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02460d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.463105:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02460d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480805.463117:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1782480805.463218:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02460d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.463226:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02460d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.463232:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02460d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.463257:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480805.463261:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02460d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.463269:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02460d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.463283:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:2.0:1782480805.463286:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782480805.463290:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02460d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.463297:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c02460d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.463341:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c024606 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fad1 expref: 38 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.463351:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d4bddc700) 00010000:00010000:2.0:1782480805.463353:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782480805.463357:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c024606 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fad1 expref: 38 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.463367:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9e00, rc 0) 00000100:00100000:2.0:1782480805.463439:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+37:11508:x1869066291720320:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 512us (2415us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1782480805.463447:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 173 00000100:00100000:0.0:1782480805.467479:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480805.467591:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291720448 00000100:00100000:3.0:1782480805.467600:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291720448 00000100:00100000:3.0:1782480805.467706:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 174 00000100:00100000:3.0:1782480805.467716:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+37:11508:x1869066291720448:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782480805.467783:0:5809:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782480805.467943:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+37:11508:x1869066291720448:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 228us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480805.467970:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 174 00000100:00100000:2.0:1782480805.473814:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480805.475501:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291720704 00000100:00100000:3.0:1782480805.475514:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291720704 00000100:00100000:3.0:1782480805.475696:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 175 00000100:00100000:3.0:1782480805.475707:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+37:11508:x1869066291720704:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480805.475729:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480805.475732:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782480805.475791:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0245c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fac3 expref: 37 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.475808:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:3.0:1782480805.475813:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782480805.475826:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c02461b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fad8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782480805.482818:0:5807:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1782480805.484872:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024622 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.485017:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.485030:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.485117:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c02461b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fad8 expref: 39 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.485148:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024622 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fad8 expref: 38 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.485156:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d4bddc100) 00010000:00010000:3.0:1782480805.485159:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480805.485162:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ec000, rc 0) 00000100:00100000:3.0:1782480805.487439:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+38:11508:x1869066291720704:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 11720us (13622us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1782480805.487451:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 175 00000100:00100000:0.0:1782480805.497256:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480805.497346:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291720960 00000100:00100000:3.0:1782480805.497357:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291720960 00000100:00100000:3.0:1782480805.497416:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 176 00000100:00100000:3.0:1782480805.497427:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+38:11508:x1869066291720960:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782480805.497487:0:11544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480805.497516:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c024622 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fad8 expref: 38 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.497535:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d4bddc100) 00010000:00010000:3.0:1782480805.497548:0:11544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782480805.497569:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c024630 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.497597:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c024630 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.497606:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c024630 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.497691:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c024637 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x9a9bab66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.497700:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c024637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a9bab66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.497708:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c024637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a9bab66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.498043:0:11544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c024630 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.498052:0:11544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c024630 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.498058:0:11544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c024630 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.498064:0:11544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821eda00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480805.498068:0:11544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c024630 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.498078:0:11544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c024630 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.498088:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:3.0:1782480805.498091:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480805.498095:0:11544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c024630 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.498101:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c024630 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.498117:0:11544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c024637 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a9bab66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.498122:0:11544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c024637 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a9bab66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.498128:0:11544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c024637 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a9bab66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.498133:0:11544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821edc00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480805.498136:0:11544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c024637 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a9bab66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.498142:0:11544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c024637 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a9bab66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.498150:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x9a9bab66 (ffff9b6d4bddcf00) 00010000:00010000:3.0:1782480805.498152:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480805.498154:0:11544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c024637 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9a9bab66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.498160:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c024637 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9a9bab66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480805.499155:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+37:11508:x1869066291720960:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 1720us (1897us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782480805.499167:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 176 00000100:00100000:3.0:1782480805.501510:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480805.501543:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291721088 00000100:00100000:3.0:1782480805.501552:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291721088 00000100:00100000:3.0:1782480805.501869:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 177 00000100:00100000:3.0:1782480805.501880:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+37:11508:x1869066291721088:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480805.501915:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480805.501935:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c02463e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fadf expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.501968:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d413f5800/0x3dc3ebf33c024645 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.501981:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d413f5800/0x3dc3ebf33c024645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.501993:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d413f5800/0x3dc3ebf33c024645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.502096:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c02463e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fadf expref: 39 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.502113:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d413f5800/0x3dc3ebf33c024645 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fadf expref: 38 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.502122:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d4bddca00) 00010000:00010000:3.0:1782480805.502125:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782480805.502128:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d413f5800, rc 0) 00000100:00100000:3.0:1782480805.502179:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+38:11508:x1869066291721088:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 302us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480805.502197:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 177 00000100:00100000:3.0:1782480805.511512:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480805.511622:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291721344 00000100:00100000:1.0:1782480805.511631:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291721344 00000100:00100000:1.0:1782480805.511698:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 178 00000100:00100000:1.0:1782480805.511709:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+38:11508:x1869066291721344:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782480805.511819:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02464c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.511852:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02464c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.511865:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02464c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782480805.512156:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1782480805.512167:0:5807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 426353419239ns, next at 427353416243ns, rc = 0 00000004:00010000:1.0:1782480805.512257:0:5807:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000183b671b reply state 0000000068b87110 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02464c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480805.512267:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782480805.512352:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+40:11508:x1869066291721344:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 645us (848us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1782480805.512359:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 178 00010000:00010000:1.0:1782480805.515444:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02464c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.515461:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02464c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.515469:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02464c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.515475:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573600 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480805.515479:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02464c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.515485:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02464c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.515520:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d4bddca00) 00010000:00010000:1.0:1782480805.515523:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782480805.515528:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02464c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.515533:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02464c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480805.516528:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480805.516733:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291721472 00000100:00100000:1.0:1782480805.516743:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291721472 00000100:00100000:1.0:1782480805.516814:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 179 00000100:00100000:1.0:1782480805.516824:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+39:11508:x1869066291721472:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480805.516847:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480805.516864:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024653 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fae6 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.516922:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024653 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fae6 expref: 40 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.516937:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024653 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fae6 expref: 40 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.516955:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d4bddca00) 00010000:00010000:1.0:1782480805.516958:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782480805.516960:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573a00, rc 0) 00000100:00100000:1.0:1782480805.517008:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+40:11508:x1869066291721472:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 186us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480805.517026:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 179 00000100:00100000:1.0:1782480805.526779:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480805.526856:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291721600 00000100:00100000:3.0:1782480805.526877:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291721600 00000100:00100000:3.0:1782480805.526952:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:3.0:1782480805.526961:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2366:x1869066291721600:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1782480805.527391:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2366:x1869066291721600:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 428us (648us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1782480805.527399:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00080000:1.0:1782480805.527542:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782480805.531852:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480805.531942:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291721856 00000100:00100000:1.0:1782480805.531953:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291721856 00000100:00100000:1.0:1782480805.532014:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:1.0:1782480805.532024:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+40:11508:x1869066291721856:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782480805.532275:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+41:11508:x1869066291721856:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 251us (432us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1782480805.532283:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:2.0:1782480805.555583:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480805.555663:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291722112 00000100:00100000:3.0:1782480805.555673:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291722112 00000100:00100000:3.0:1782480805.555732:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 180 00000100:00100000:3.0:1782480805.555742:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+41:11508:x1869066291722112:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782480805.555865:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+41:11508:x1869066291722112:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 123us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480805.555871:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 180 00000100:00100000:3.0:1782480805.558083:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480805.558125:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291722240 00000100:00100000:3.0:1782480805.558133:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291722240 00000100:00100000:3.0:1782480805.558181:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 181 00000100:00100000:3.0:1782480805.560468:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+41:11508:x1869066291722240:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480805.560493:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480805.560512:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c02465a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3faed expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.560595:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c024661 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.560610:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c024661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.560629:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c024661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480805.560668:0:10450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480805.560687:0:10450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c024661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.560714:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c02465a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faed expref: 43 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.560732:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c024661 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faed expref: 42 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.560740:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d4bddca00) 00010000:00010000:3.0:1782480805.560743:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782480805.560762:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d82165e00, rc 0) 00000100:00100000:3.0:1782480805.560829:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+42:11508:x1869066291722240:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 374us (2753us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480805.570706:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 181 00010000:00010000:3.0:1782480805.570802:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480805.570898:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480805.570961:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291722368 00000100:00100000:3.0:1782480805.570969:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291722368 00000100:00100000:3.0:1782480805.571016:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:3.0:1782480805.571025:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2366:x1869066291722368:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480805.571052:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480805.571071:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003264ef18/0x3dc3ebf33c024668 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3faf4 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782480805.571112:0:6602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3e7fa6, blocks: 0x1 00010000:00010000:3.0:1782480805.571130:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1782480805.571135:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480805.571144:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003264ef18/0x3dc3ebf33c024668 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faf4 expref: 8 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.571160:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003264ef18/0x3dc3ebf33c024668 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faf4 expref: 8 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.571173:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d82164e00, rc 0) 00000100:00100000:3.0:1782480805.571595:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2366:x1869066291722368:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 569us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480805.571602:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:2.0:1782480805.576516:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480805.576599:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291722624 00000100:00100000:3.0:1782480805.576610:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291722624 00000100:00100000:3.0:1782480805.576677:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 182 00000100:00100000:3.0:1782480805.576686:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+42:11508:x1869066291722624:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782480805.576826:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+42:11508:x1869066291722624:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 140us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480805.576834:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 182 00000100:00100000:2.0:1782480805.592852:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480805.592922:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291722752 00000100:00100000:3.0:1782480805.592933:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291722752 00000100:00100000:3.0:1782480805.593412:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:3.0:1782480805.593424:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+8:11508:x1869066291722752:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480805.593453:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480805.593472:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fa7b862/0x3dc3ebf33c02466f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fafb expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.593503:0:8678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003264ef18/0x3dc3ebf33c024668 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faf4 expref: 9 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.593512:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480805.593516:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480805.593521:0:8678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fa7b862/0x3dc3ebf33c02466f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fafb expref: 9 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.593555:0:8678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003264ef18/0x3dc3ebf33c024668 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faf4 expref: 9 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.593568:0:8678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003264ef18/0x3dc3ebf33c024668 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faf4 expref: 9 pid: 6602 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480805.593582:0:8678:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8678:1869066311641856:192.168.204.51@tcp:104: 00000100:00100000:3.0:1782480805.593670:0:8678:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d460dc300 going to sleep for 11 seconds 00000100:00100000:0.0:1782480805.599934:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480805.599971:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291722880 00000100:00100000:0.0:1782480805.599981:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291722880 00010000:00010000:0.0:1782480805.600023:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003264ef18/0x3dc3ebf33c024668 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faf4 expref: 10 pid: 6602 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480805.600076:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:0.0:1782480805.600086:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+10:2366:x1869066291722880:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480805.600102:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480805.600127:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003264ef18/0x3dc3ebf33c024668 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faf4 expref: 10 pid: 6602 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.600141:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003264ef18/0x3dc3ebf33c024668 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faf4 expref: 10 pid: 6602 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.600167:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480805.600185:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480805.600206:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000fa7b862/0x3dc3ebf33c02466f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fafb expref: 10 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.600218:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fa7b862/0x3dc3ebf33c02466f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fafb expref: 10 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.600392:0:5794:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000fa7b862/0x3dc3ebf33c02466f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fafb expref: 10 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480805.600410:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5794:1869066311641984:192.168.204.51@tcp:105: 00000100:00100000:0.0:1782480805.600492:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d48e6f3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1782480805.600740:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003264ef18/0x3dc3ebf33c024668 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faf4 expref: 10 pid: 6602 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480805.600777:0:8678:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8678:1869066311641856:192.168.204.51@tcp:104: 00010000:00010000:3.0:1782480805.600801:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000fa7b862/0x3dc3ebf33c02466f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fafb expref: 9 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.600820:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d82164000, rc 0) 00000100:00100000:3.0:1782480805.600857:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+9:11508:x1869066291722752:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 7435us (8016us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480805.600865:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:1.0:1782480805.623980:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480805.624988:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291723008 00000100:00100000:3.0:1782480805.625000:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291723008 00002000:00100000:3.0:1782480805.625062:0:6608:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9b6d75541f80 x1869066291723008/t0(0) o4->49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp:561/0 lens 504/0 e 0 to 0 dl 1782480816 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782480805.625073:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d75541f80 with x1869066291723008 ext(0->8) 00002000:00010000:3.0:1782480805.625080:0:6608:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d75541f80 00000100:00100000:3.0:1782480805.625116:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:3.0:1782480805.625126:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+9:2367:x1869066291723008:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1782480805.625624:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75541f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+11:2367:x1869066291723008:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 Request processed in 499us (1654us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1782480805.625634:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00002000:00100000:3.0:1782480805.625641:0:6608:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9b6d75541f80 x1869066291723008/t4294967314(0) o4->49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp:561/0 lens 504/448 e 0 to 0 dl 1782480816 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782480805.625649:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d75541f80 with x1869066291723008 ext(0->8) 00002000:00010000:3.0:1782480805.625653:0:6608:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d75541f80 00000100:00100000:0.0:1782480805.626812:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5794:1869066311641984:192.168.204.51@tcp:105: 00010000:00010000:0.0:1782480805.626840:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480805.626881:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+10:2366:x1869066291722880:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 26796us (26957us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480805.626905:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:2.0:1782480805.633407:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480805.633490:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291723136 00000100:00100000:3.0:1782480805.633499:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291723136 00000100:00100000:3.0:1782480805.633561:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 183 00000100:00100000:3.0:1782480805.633571:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+42:11508:x1869066291723136:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1782480805.715556:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+42:11508:x1869066291723136:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 Request processed in 81974us (82149us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480805.715572:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 183 00000001:00080000:3.0:1782480805.715620:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000001:00080000:3.0:1782480805.715644:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1782480805.715651:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1782480805.715680:0:5829:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1782480805.715952:0:5841:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1782480805.715963:0:5841:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1782480805.715978:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311642112:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1782480805.716041:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480805.716105:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311642112 00000100:00100000:3.0:1782480805.716114:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311642112 00000100:00100000:3.0:1782480805.716161:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782480805.716171:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311642112:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1782480805.720207:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1782480805.720216:0:6605:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782480806 00002000:00010000:3.0:1782480805.720220:0:6605:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1782480805.720222:0:6605:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1782480806 -> 1782480806 00002000:00010000:3.0:1782480805.720224:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000040:00080000:2.0:1782480805.720726:0:12317:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782480805.720733:0:12317:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782480805.720792:0:12317:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1782480805.720800:0:12317:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782480805.720967:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1869066311642112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4792us (4933us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1782480805.720978:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1782480805.721018:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782480805.721948:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480805.721983:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291723264 00000100:00100000:3.0:1782480805.721992:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291723264 00000100:00100000:3.0:1782480805.722067:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:3.0:1782480805.722077:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+10:2368:x1869066291723264:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1782480805.722859:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d75f3ce00/2, rc 0, transno 4294967315 00000100:00100000:2.0:1782480805.722869:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311642112:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1782480805.792925:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+10:2368:x1869066291723264:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 Request processed in 70838us (70970us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480805.792938:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 55 00000001:00080000:3.0:1782480805.792976:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1782480805.792985:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:2.0:1782480805.800004:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480805.800092:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291723520 00000100:00100000:0.0:1782480805.800101:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291723520 00000100:00100000:0.0:1782480805.800160:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 184 00000100:00100000:0.0:1782480805.800171:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+18:11508:x1869066291723520:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782480805.800231:0:10450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480805.800268:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c024661 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faed expref: 18 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.800285:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d4bddca00) 00010000:00010000:0.0:1782480805.800301:0:10450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480805.800342:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c024676 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.800358:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c024676 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.800368:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c024676 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782480805.800611:0:10450:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bcbfa889 reply state 00000000da34f4ba transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c024676 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480805.800621:0:10450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782480805.800718:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+19:11508:x1869066291723520:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 548us (723us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1782480805.800725:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 184 00010000:00010000:0.0:1782480805.803725:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c024676 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.803742:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c024676 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.803763:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c024676 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.803769:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2cc00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480805.803774:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c024676 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.803782:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c024676 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.803819:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d4bddca00) 00010000:00010000:0.0:1782480805.803823:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480805.803828:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c024676 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.803835:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c024676 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480805.805685:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480805.806214:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291723648 00000100:00100000:3.0:1782480805.806225:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291723648 00000100:00100000:3.0:1782480805.806561:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:3.0:1782480805.806572:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f12b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2367:x1869066291723648:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1782480805.807014:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1782480805.807018:0:6605:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1782480806 -> 1782480804 00002000:00010000:3.0:1782480805.807021:0:6605:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1782480803 00002000:00010000:3.0:1782480805.807023:0:6605:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1782480806 -> 1782480804 00002000:00010000:3.0:1782480805.807036:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1782480805.807133:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f12b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2367:x1869066291723648:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 562us (1454us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1782480805.807142:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:2.0:1782480805.822722:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480805.824692:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291723904 00000100:00100000:0.0:1782480805.824706:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291723904 00000100:00100000:1.0:1782480805.824890:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 185 00000100:00100000:1.0:1782480805.824902:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+18:11508:x1869066291723904:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1782480805.824972:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c02467d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.824990:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d413f5800/0x3dc3ebf33c024645 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fadf expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.825000:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c02467d lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.825046:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d413f5800/0x3dc3ebf33c024645 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fadf expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.825061:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d413f5800/0x3dc3ebf33c024645 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fadf expref: 18 pid: 5809 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480805.825083:0:5808:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75540a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1869066311642240:192.168.204.51@tcp:104: 00000100:00100000:1.0:1782480805.825179:0:5808:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d460160c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480805.831653:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480805.832704:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291724032 00000100:00100000:2.0:1782480805.832715:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291724032 00010000:00010000:2.0:1782480805.832778:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d413f5800/0x3dc3ebf33c024645 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fadf expref: 19 pid: 5809 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480805.832892:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:2.0:1782480805.832903:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+19:2366:x1869066291724032:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480805.832919:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480805.832927:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d413f5800/0x3dc3ebf33c024645 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fadf expref: 19 pid: 5809 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.832952:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d413f5800/0x3dc3ebf33c024645 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fadf expref: 19 pid: 5809 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.832976:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d4bddca00) 00010000:00010000:2.0:1782480805.832982:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c02467d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.832992:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c02467d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.832999:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c02467d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.833019:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480805.833087:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+19:2366:x1869066291724032:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 185us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480805.833096:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 70 00010000:00010000:0.0:1782480805.834555:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d413f5800/0x3dc3ebf33c024645 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fadf expref: 18 pid: 5809 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480805.834577:0:5808:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75540a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1869066311642240:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480805.834597:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c02467d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.834606:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c02467d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.834613:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c02467d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.835947:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c02467d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.835962:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c02467d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.835970:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c02467d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.835984:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572e00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480805.835989:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c02467d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.835996:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c02467d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.836013:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d4bddca00) 00010000:00010000:0.0:1782480805.836017:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1782480805.836021:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c02467d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.836038:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c02467d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480805.836907:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+17:11508:x1869066291723904:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 Request processed in 11999us (14187us total) trans 0 rc -22/-22 00000100:00100000:0.0:1782480805.836920:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 185 00000100:00100000:0.0:1782480805.848002:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480805.850944:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291724160 00000100:00100000:2.0:1782480805.850957:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291724160 00000100:00100000:2.0:1782480805.851058:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:2.0:1782480805.851070:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2369:x1869066291724160:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1782480805.851117:0:8678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024684 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.851136:0:8678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000fa7b862/0x3dc3ebf33c02466f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fafb expref: 8 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.851158:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480805.851162:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782480805.851166:0:8678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024684 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.851202:0:8678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000fa7b862/0x3dc3ebf33c02466f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fafb expref: 8 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.851215:0:8678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000fa7b862/0x3dc3ebf33c02466f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fafb expref: 8 pid: 8678 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480805.851231:0:8678:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8678:1869066311642368:192.168.204.51@tcp:104: 00000100:00100000:2.0:1782480805.851539:0:8678:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d756269c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480805.854741:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480805.854917:0:8678:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8678:1869066311642368:192.168.204.51@tcp:104: 00010000:00010000:3.0:1782480805.854944:0:8678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024684 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480805.855020:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291724288 00000100:00100000:0.0:1782480805.855038:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291724288 00010000:00010000:0.0:1782480805.855072:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000fa7b862/0x3dc3ebf33c02466f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fafb expref: 9 pid: 8678 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480805.855147:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:0.0:1782480805.855157:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75540000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+9:2366:x1869066291724288:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480805.855173:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480805.855196:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000fa7b862/0x3dc3ebf33c02466f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fafb expref: 9 pid: 8678 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.855214:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000fa7b862/0x3dc3ebf33c02466f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fafb expref: 9 pid: 8678 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.855236:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fa7b862/0x3dc3ebf33c02466f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fafb expref: 9 pid: 8678 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.855255:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782480805.855259:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782480805.855265:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024684 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.855274:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024684 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.855320:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480805.855369:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75540000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2366:x1869066291724288:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 213us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480805.855377:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 71 00010000:00010000:3.0:1782480805.855426:0:8678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024684 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.855440:0:8678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024684 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.855463:0:8678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024684 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.855472:0:8678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024684 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.855481:0:8678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024684 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.855488:0:8678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8400 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:3.0:1782480805.855492:0:8678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024684 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.855500:0:8678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024684 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.855511:0:8678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024684 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.855518:0:8678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024684 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480805.855570:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2369:x1869066291724160:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 Request processed in 4503us (7577us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480805.855578:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:0.0:1782480805.863936:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480805.864006:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291724544 00000100:00100000:1.0:1782480805.864016:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291724544 00000100:00100000:1.0:1782480805.864078:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 186 00000100:00100000:1.0:1782480805.864087:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+17:11508:x1869066291724544:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1782480805.864159:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02468b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.864175:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02468b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.864186:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02468b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.864459:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c024692 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.864470:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024653 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fae6 expref: 18 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.864478:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c024692 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.864506:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024653 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fae6 expref: 18 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480805.864529:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024653 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fae6 expref: 18 pid: 11544 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480805.864542:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75541c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1869066311642496:192.168.204.51@tcp:104: 00000100:00100000:1.0:1782480805.864615:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46016c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782480805.867134:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480805.867198:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75541c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1869066311642496:192.168.204.51@tcp:104: 00010000:00010000:1.0:1782480805.867223:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c024692 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480805.867267:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291724672 00000100:00100000:2.0:1782480805.867277:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291724672 00010000:00010000:2.0:1782480805.867430:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024653 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fae6 expref: 19 pid: 11544 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480805.867468:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:2.0:1782480805.867477:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+19:2366:x1869066291724672:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480805.867492:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480805.867498:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024653 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fae6 expref: 19 pid: 11544 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.867510:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024653 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fae6 expref: 19 pid: 11544 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.867538:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c024653 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fae6 expref: 19 pid: 11544 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.867559:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d4bddca00) 00010000:00010000:2.0:1782480805.867641:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c024692 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.867653:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c024692 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.867661:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c024692 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.867695:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480805.867744:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+18:2366:x1869066291724672:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 267us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480805.867770:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 72 00010000:00010000:0.0:1782480805.867785:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c024692 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.867793:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c024692 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782480805.867975:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1782480805.868157:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1782480805.868204:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1782480805.868292:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5807:1869066311642624:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782480805.869003:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480805.869048:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d47c78c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480805.869073:0:5813:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311642624 00000100:00100000:3.0:1782480805.869080:0:5813:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311642624 00000100:00100000:3.0:1782480805.869128:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782480805.869136:0:5813:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1869066311642624:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1782480805.869260:0:5813:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1869066311642624:12345-0@lo:1000:mdt00_000.0 Request processed in 124us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480805.869268:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782480805.870246:0:5807:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1782480805.870255:0:5807:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d75f3ce00, transno 4294967315 00000100:00100000:2.0:1782480805.870270:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5807:1869066311642624:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1782480805.870830:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1782480805.870973:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7ac1df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5807:1869066311642752:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782480805.871036:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480805.871070:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75626180 going to sleep for 11 seconds 00000100:00100000:1.0:1782480805.871543:0:5813:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311642752 00000100:00100000:1.0:1782480805.871551:0:5813:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311642752 00000100:00100000:1.0:1782480805.872106:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782480805.872117:0:5813:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1869066311642752:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782480805.872336:0:5813:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5807:x1869066311642752:12345-0@lo:1000:mdt00_000.0 Request processed in 220us (1310us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1782480805.872343:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782480805.873857:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7ac1df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5807:1869066311642752:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1782480805.873920:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c024692 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.873939:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c024692 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.873946:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c024692 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.873952:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573e00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480805.873956:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c024692 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.873963:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c024692 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.873997:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d4bddca00) 00010000:00010000:3.0:1782480805.874000:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782480805.874004:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c024692 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.874011:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c024692 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.874055:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0245ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.874060:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0245ce lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.874064:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0245ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.874067:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480805.874069:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0245ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.874073:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0245ce lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.874078:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:3.0:1782480805.874080:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782480805.874082:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0245ce lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.874085:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0245ce lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.874108:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024699 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.874119:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0245ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faca expref: 21 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.874126:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024699 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.874165:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0245ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faca expref: 21 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480805.874177:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0245ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faca expref: 21 pid: 11544 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480805.874192:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fe73800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1869066311642880:192.168.204.51@tcp:104: 00000100:00100000:3.0:1782480805.874289:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51139f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782480805.910320:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480805.910351:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291724800 00000100:00100000:2.0:1782480805.910360:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291724800 00010000:00010000:2.0:1782480805.910418:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0245ea lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faca expref: 22 pid: 11544 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480805.910454:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:2.0:1782480805.910464:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+22:2367:x1869066291724800:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480805.910478:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480805.910485:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0245ea lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faca expref: 22 pid: 11544 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.910498:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0245ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faca expref: 22 pid: 11544 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.910521:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:2.0:1782480805.910526:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024699 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.910536:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024699 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.910544:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024699 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.910562:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480805.910578:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0245ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3faca expref: 22 pid: 11544 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480805.910596:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fe73800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1869066311642880:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480805.910628:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024699 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.910638:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024699 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.910644:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024699 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.910656:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024699 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.910662:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024699 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.910668:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024699 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.910673:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d82164e00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480805.910677:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024699 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.910696:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024699 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.910705:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:0.0:1782480805.910708:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480805.910712:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024699 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.910717:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024699 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.910729:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02468b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.910735:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02468b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.910740:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02468b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.910744:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573600 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480805.910765:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02468b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.910771:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02468b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.910778:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:0.0:1782480805.910780:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782480805.910783:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02468b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.910797:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c02468b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480805.911043:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+21:11508:x1869066291724544:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 46954us (47115us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1782480805.911054:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 186 00000020:00080000:0.0:1782480805.911059:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1782480805.911172:0:11541:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480805.911392:0:11541:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480805.912125:0:11541:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1782480805.912136:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782480805.916426:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+20:2367:x1869066291724800:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 5954us (6108us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480805.916440:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:2.0:1782480805.927833:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480805.927869:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291725056 00000100:00100000:2.0:1782480805.927879:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291725056 00000100:00100000:2.0:1782480805.927941:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:2.0:1782480805.927951:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45d54450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+20:11508:x1869066291725056:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1782480805.932197:0:5811:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1782480805.932362:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1782480805.932442:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0246a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.933512:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0246a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.933531:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0246a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.933541:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0246a0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.933548:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0246a0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.933554:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0246a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480805.933647:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782480805.933781:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45d54450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+22:11508:x1869066291725056:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 5826us (5953us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1782480805.933791:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 50 00000020:00080000:2.0:1782480805.933797:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782480805.934088:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480805.934094:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0246a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.934102:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9400 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:0.0:1782480805.934105:0:7486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0246a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.934113:0:7486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0246a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.934125:0:7486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b6d45d62500) 00010000:00010000:0.0:1782480805.934128:0:7486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782480805.934133:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0246a0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.934139:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c0246a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480805.934174:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480805.934176:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480805.934178:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480806.583131:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480806.650422:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fe73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311643008:0@lo:400:kworker.0 00000100:00100000:2.0:1782480806.650497:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480806.650567:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fe72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066311643520:0@lo:400:kworker.0 00000100:00100000:2.0:1782480806.650598:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480806.650623:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782480806.650635:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fe72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311643392:0@lo:400:kworker.0 00000100:00100000:2.0:1782480806.650661:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480806.650693:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311643520 00000100:00100000:2.0:1782480806.650700:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311643520 00000100:00100000:2.0:1782480806.650787:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1782480806.650808:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066311643520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480806.651043:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066311643520:12345-0@lo:400:kworker.0 Request processed in 247us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480806.651051:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1782480806.651077:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311643392 00000100:00100000:2.0:1782480806.651081:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311643392 00000100:00100000:2.0:1782480806.651111:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1782480806.651119:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311643392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480806.651150:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311643392:12345-0@lo:400:kworker.0 Request processed in 33us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480806.651156:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1782480806.651171:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782480806.651176:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480806.651200:0:3316:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1782480806.651206:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1782480806.651225:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d75f06d80, transno 4294967307 00000100:00100000:2.0:1782480806.651250:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fe72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311643392:0@lo:400:kworker.0 00000100:00100000:2.0:1782480806.651263:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fe72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066311643520:0@lo:400:kworker.0 00000100:00100000:3.0:1782480806.651591:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311643008 00000100:00100000:3.0:1782480806.651596:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311643008 00000100:00100000:3.0:1782480806.651635:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1782480806.651644:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3316:x1869066311643008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480806.651683:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3316:x1869066311643008:12345-0@lo:400:kworker.0 Request processed in 41us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480806.651690:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1782480806.651964:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fe73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311643008:0@lo:400:kworker.0 00000100:00100000:1.0:1782480806.652175:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fe71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869066311643136:0@lo:400:kworker.0 00000100:00100000:1.0:1782480806.652218:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480806.652252:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fe71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311643648:0@lo:400:kworker.0 00000100:00100000:1.0:1782480806.652274:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480806.652301:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782480806.652307:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fe73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311643264:0@lo:400:kworker.0 00000100:00100000:1.0:1782480806.652327:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480806.652463:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311643136 00000100:00100000:0.0:1782480806.652469:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311643136 00000100:00100000:0.0:1782480806.652500:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311643264 00000100:00100000:0.0:1782480806.652503:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311643264 00000100:00100000:0.0:1782480806.652530:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782480806.652536:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869066311643136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480806.652576:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869066311643136:12345-0@lo:400:kworker.0 Request processed in 41us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480806.652582:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1782480806.652593:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1782480806.652599:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311643264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480806.652620:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311643264:12345-0@lo:400:kworker.0 Request processed in 23us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480806.652625:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1782480806.652640:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480806.652657:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fe73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311643264:0@lo:400:kworker.0 00000100:00100000:0.0:1782480806.652666:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fe71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869066311643136:0@lo:400:kworker.0 00000100:00100000:3.0:1782480806.652770:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311643648 00000100:00100000:3.0:1782480806.652774:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311643648 00000100:00100000:3.0:1782480806.652816:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1782480806.652840:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1869066311643648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480806.652876:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1869066311643648:12345-0@lo:400:kworker.0 Request processed in 46us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480806.652881:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782480806.653113:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fe71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311643648:0@lo:400:kworker.0 00000100:00100000:0.0:1782480807.160987:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480807.161021:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311643776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480807.161090:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480807.161157:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311643776 00000100:00100000:0.0:1782480807.161177:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311643776 00000100:00100000:0.0:1782480807.161229:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782480807.161238:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1869066311643776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782480807.161276:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480807.161318:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1869066311643776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480807.161325:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1782480807.161345:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782480807.161382:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311643776:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782480807.606946:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782480807.679094:0:12369:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480807.679104:0:12369:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480807.679156:0:12369:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1782480807.679162:0:12369:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782480807.844396:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480807.844485:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291725312 00000100:00100000:0.0:1782480807.844495:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291725312 00000100:00100000:0.0:1782480807.844580:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 187 00000100:00100000:0.0:1782480807.844590:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+22:11527:x1869066291725312:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1782480807.844614:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480807.844633:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c0246a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb02 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.844908:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c0246ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.844924:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c0246ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.844935:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c0246ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480807.844954:0:11544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1782480807.845138:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c0246a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb02 expref: 25 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.845155:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c0246ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb02 expref: 24 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.845174:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:0.0:1782480807.845177:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782480807.845180:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2de00, rc 0) 00000100:00100000:0.0:1782480807.845238:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+24:11527:x1869066291725312:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 649us (851us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1782480807.845245:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 187 00000100:00080000:2.0:1782480807.845622:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480807.850488:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480807.850551:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291725440 00000100:00100000:0.0:1782480807.850560:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291725440 00000100:00100000:0.0:1782480807.850614:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 188 00000100:00100000:0.0:1782480807.850624:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+24:11527:x1869066291725440:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:0.0:1782480807.850693:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c0246bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.850710:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c0246bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.850721:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c0246bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.850735:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c0246c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.850795:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c0246c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.850803:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c0246c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851100:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0246ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851108:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0246ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851115:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0246ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782480807.851152:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0246ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851176:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c0246bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851183:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c0246bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851189:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c0246bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851194:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2da00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480807.851201:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c0246bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851208:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c0246bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851227:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:0.0:1782480807.851230:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480807.851234:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c0246bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851241:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c0246bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851252:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c0246c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851259:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c0246c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851264:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c0246c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851268:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2ca00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480807.851271:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c0246c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851276:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c0246c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851283:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d43255900) 00010000:00010000:0.0:1782480807.851285:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480807.851288:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c0246c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851293:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c0246c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851320:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0246ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851326:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0246ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851332:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0246ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851337:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480807.851340:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0246ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851345:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0246ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851353:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d43255500) 00010000:00010000:0.0:1782480807.851355:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480807.851358:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0246ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480807.851363:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c0246ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480807.851437:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+24:11527:x1869066291725440:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 813us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480807.851447:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 188 00000100:00100000:3.0:1782480807.926631:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480807.929860:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291725696 00000100:00100000:2.0:1782480807.929876:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291725696 00000100:00100000:2.0:1782480807.929949:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 189 00000100:00100000:2.0:1782480807.929961:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+24:11530:x1869066291725696:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1782480807.929982:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480807.930013:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0246d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb09 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930081:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0246d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930095:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0246d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930106:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0246d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930118:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0246df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930124:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0246df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930129:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0246df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930419:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0246e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930436:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0246e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930445:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0246e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480807.930455:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1782480807.930549:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0246d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930557:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0246d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930563:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0246d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930569:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8a00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480807.930573:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0246d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930580:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0246d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930593:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:2.0:1782480807.930596:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480807.930600:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0246d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930606:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c0246d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930617:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0246df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930629:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0246df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930634:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0246df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930638:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480807.930642:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0246df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930647:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0246df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930654:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d45d62d00) 00010000:00010000:2.0:1782480807.930657:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480807.930659:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0246df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930664:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0246df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930706:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c0246d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb09 expref: 27 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930718:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0246e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb09 expref: 26 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.930726:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62900) 00010000:00010000:2.0:1782480807.930728:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782480807.930737:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9e00, rc 0) 00000100:00100000:2.0:1782480807.930836:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+26:11530:x1869066291725696:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 876us (4213us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1782480807.930844:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 189 00000100:00100000:3.0:1782480807.933276:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480807.934301:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291725824 00000100:00100000:2.0:1782480807.934313:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291725824 00000100:00100000:2.0:1782480807.934383:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 190 00000100:00100000:2.0:1782480807.934395:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+26:11530:x1869066291725824:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:2.0:1782480807.934464:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0246f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.934480:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0246f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.934491:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0246f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.934516:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0246f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.934523:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0246f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.934529:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0246f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.934536:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480807.934540:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0246f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.934548:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0246f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.934570:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62900) 00010000:00010000:2.0:1782480807.934573:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782480807.934577:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0246f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480807.934583:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c0246f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480807.934663:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+26:11530:x1869066291725824:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 270us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480807.934672:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 190 00000100:00100000:2.0:1782480807.938355:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480807.938396:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291726080 00000100:00100000:2.0:1782480807.938406:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291726080 00000100:00100000:2.0:1782480807.938454:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:2.0:1782480807.938464:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+26:11530:x1869066291726080:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1782480807.938697:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+27:11530:x1869066291726080:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 233us (346us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1782480807.938705:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:3.0:1782480807.977780:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480807.977816:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291726336 00000100:00100000:3.0:1782480807.977825:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291726336 00000100:00100000:3.0:1782480807.977874:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 191 00000100:00100000:3.0:1782480807.977882:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+27:11056:x1869066291726336:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1782480807.977906:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480807.977923:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c0246fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb10 expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480807.978035:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024702 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480807.978050:0:10450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0246e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb09 expref: 28 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480807.978059:0:10450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024702 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480807.978094:0:10450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0246e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb09 expref: 28 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480807.978106:0:10450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0246e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb09 expref: 28 pid: 5807 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480807.978132:0:10450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fe71880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10450:1869066311643904:192.168.204.51@tcp:104: 00000100:00100000:3.0:1782480807.978223:0:10450:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46a5ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1782480807.987715:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480807.987796:0:10450:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fe71880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10450:1869066311643904:192.168.204.51@tcp:104: 00010000:00010000:3.0:1782480807.987824:0:10450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024702 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480807.987852:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291726464 00000100:00100000:3.0:1782480807.987857:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291726464 00010000:00010000:3.0:1782480807.987891:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0246e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb09 expref: 29 pid: 5807 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480807.987924:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00100000:3.0:1782480807.987933:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+29:2366:x1869066291726464:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480807.987950:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480807.987956:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0246e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb09 expref: 29 pid: 5807 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480807.987967:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0246e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb09 expref: 29 pid: 5807 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480807.988007:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0246e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb09 expref: 29 pid: 5807 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480807.988021:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62900) 00010000:00010000:3.0:1782480807.988034:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024702 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480807.988044:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024702 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480807.988051:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024702 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480807.988072:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480807.988122:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+28:2366:x1869066291726464:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 189us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480807.988130:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 74 00010000:00010000:3.0:1782480807.988151:0:10450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024702 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480807.988158:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024702 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480807.988174:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1782480807.988312:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c0246fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb10 expref: 29 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480807.988328:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024702 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb10 expref: 28 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480807.988335:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62900) 00010000:00010000:3.0:1782480807.988339:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782480807.988342:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d82164e00, rc 0) 00000100:00100000:3.0:1782480807.988367:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+28:11056:x1869066291726336:12345-192.168.204.51@tcp:101:bash.0 Request processed in 10485us (10597us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1782480807.988381:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 191 00000100:00100000:3.0:1782480808.005608:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480808.005640:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291726720 00000100:00100000:3.0:1782480808.005650:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291726720 00000100:00100000:3.0:1782480808.005706:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 192 00000100:00100000:3.0:1782480808.005716:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+28:11056:x1869066291726720:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:3.0:1782480808.006001:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024710 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.006018:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024710 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.006029:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024710 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782480808.006076:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1782480808.006100:0:5809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000648f46a1 reply state 00000000b86cb310 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024710 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480808.006109:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1782480808.006152:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1782480808.006410:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+32:11056:x1869066291726720:12345-192.168.204.51@tcp:36:bash.0 Request processed in 694us (809us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1782480808.006419:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 192 00000020:00080000:3.0:1782480808.006424:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1782480808.014085:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480808.014136:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291726848 00000100:00100000:1.0:1782480808.014145:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291726848 00000100:00100000:1.0:1782480808.014405:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 193 00000100:00100000:1.0:1782480808.014415:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+32:11056:x1869066291726848:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1782480808.014440:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480808.014459:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c024717 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb17 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.014515:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c024717 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb17 expref: 33 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.014530:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c024717 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb17 expref: 33 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.014548:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62900) 00010000:00010000:1.0:1782480808.014551:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782480808.014554:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573200, rc 0) 00000100:00100000:1.0:1782480808.014621:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+33:11056:x1869066291726848:12345-192.168.204.51@tcp:101:bash.0 Request processed in 208us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480808.014628:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 193 00010000:00010000:3.0:1782480808.014807:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024710 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.014817:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024710 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.014833:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024710 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.014839:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d82164000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480808.014843:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024710 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.014850:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024710 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.014862:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62900) 00010000:00010000:3.0:1782480808.014865:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480808.014868:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024710 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.014874:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024710 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480808.024451:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480808.024537:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291726976 00000100:00100000:2.0:1782480808.024546:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291726976 00000100:00100000:2.0:1782480808.024671:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:2.0:1782480808.024682:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+7:11056:x1869066291726976:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1782480808.024699:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480808.024720:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c02471e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb1e expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782480808.024799:0:6602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a3e7fa4, atime: 0x6a3e7fa3, ctime: 0x6a3e7fa4, blocks: 0xb 00010000:00010000:2.0:1782480808.024823:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=428s v=(0 0) 00010000:00010000:2.0:1782480808.024828:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480808.024837:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c02471e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb1e expref: 8 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.024852:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c02471e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb1e expref: 8 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.024864:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9800, rc 0) 00000100:00100000:2.0:1782480808.024917:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+8:11056:x1869066291726976:12345-192.168.204.51@tcp:101:bash.0 Request processed in 236us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480808.024924:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00080000:0.0:1782480808.027346:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782480808.028614:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480808.029524:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291727104 00000100:00100000:3.0:1782480808.029536:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291727104 00002000:00010000:3.0:1782480808.029766:0:6609:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1782480808.029772:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d7f1c3480 with x1869066291727104 ext(0->18446744073709551615) 00002000:00010000:3.0:1782480808.029785:0:6609:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d7f1c3480. 00000100:00100000:2.0:1782480808.034194:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:2.0:1782480808.034219:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2367:x1869066291727104:12345-192.168.204.51@tcp:10:bash.0 00000100:00100000:3.0:1782480808.034228:0:6609:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1782480808.034415:0:6609:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00002000:00010000:0.0:1782480808.036404:0:6608:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1782480808.036419:0:6608:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1782480804 -> 1782480808 00002000:00010000:0.0:1782480808.036422:0:6608:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1782480803 -> 1782480803 00002000:00010000:0.0:1782480808.036424:0:6608:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1782480804 -> 1782480808 00002000:00010000:0.0:1782480808.036426:0:6608:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1782480808.036507:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+9:2367:x1869066291727104:12345-192.168.204.51@tcp:10:bash.0 Request processed in 2295us (7894us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1782480808.036519:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00002000:00010000:0.0:1782480808.036525:0:6608:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1782480808.036529:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d7f1c3480 with x1869066291727104 ext(0->18446744073709551615) 00002000:00010000:0.0:1782480808.036535:0:6608:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d7f1c3480. 00000100:00100000:1.0:1782480808.123586:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480808.123788:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291727232 00000100:00100000:3.0:1782480808.123798:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291727232 00000100:00100000:3.0:1782480808.123851:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 194 00000100:00100000:3.0:1782480808.123862:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+32:11544:x1869066291727232:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:3.0:1782480808.123945:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024725 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.123961:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024725 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.123972:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024725 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.124000:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c02472c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.124008:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c02472c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.124014:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c02472c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134592:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024733 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134613:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134626:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480808.134675:0:10450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134702:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024725 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134709:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024725 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134716:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024725 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134722:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d82164000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480808.134726:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024725 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134733:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024725 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134764:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:2.0:1782480808.134768:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480808.134773:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024725 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134779:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024725 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134797:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c02472c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134804:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c02472c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134808:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c02472c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134819:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d82165200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480808.134822:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c02472c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134828:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c02472c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134836:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d4bddca00) 00010000:00010000:2.0:1782480808.134838:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480808.134841:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c02472c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134846:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c02472c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134862:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134867:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024733 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134873:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024733 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134877:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480808.134880:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024733 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134886:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024733 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134905:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62900) 00010000:00010000:2.0:1782480808.134907:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480808.134910:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024733 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.134915:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024733 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480808.135024:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+32:11544:x1869066291727232:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 11159us (11443us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480808.135035:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 194 00000100:00100000:2.0:1782480808.182023:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480808.182108:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291727488 00000100:00100000:0.0:1782480808.182118:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291727488 00000100:00100000:0.0:1782480808.182192:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 195 00000100:00100000:0.0:1782480808.182203:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+32:11547:x1869066291727488:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1782480808.182222:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480808.182242:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c02473a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb25 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.182319:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024741 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.182335:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024741 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.182348:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024741 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.182362:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c024748 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.182382:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c024748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.182389:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c024748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.183269:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c02474f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.183281:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c02474f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.183288:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c02474f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480808.183298:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1782480808.183390:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024741 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.183398:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024741 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.183405:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024741 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.183411:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2ca00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480808.183415:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024741 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.183422:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024741 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.183444:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:0.0:1782480808.183447:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480808.183452:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024741 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.183457:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024741 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.183470:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c024748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.183477:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c024748 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.183481:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c024748 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.183486:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2da00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480808.185873:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c024748 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.185888:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c024748 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.185905:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d43255500) 00010000:00010000:0.0:1782480808.185907:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480808.185912:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c024748 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.185919:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c024748 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.186727:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c400/0x3dc3ebf33c02473a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb25 expref: 35 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.186887:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c02474f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb25 expref: 34 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.186895:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62900) 00010000:00010000:0.0:1782480808.186898:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1782480808.186900:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2d400, rc 0) 00000100:00100000:0.0:1782480808.189533:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+34:11547:x1869066291727488:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 7320us (7509us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1782480808.189547:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 195 00000100:00100000:3.0:1782480808.196585:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480808.196796:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291727616 00000100:00100000:1.0:1782480808.196807:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291727616 00000100:00100000:1.0:1782480808.196863:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 196 00000100:00100000:1.0:1782480808.196874:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+34:11547:x1869066291727616:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:1.0:1782480808.196949:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c02475d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.196997:0:11544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024702 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb10 expref: 34 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.197008:0:11544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c02475d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.197042:0:11544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024702 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb10 expref: 34 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.197056:0:11544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024702 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb10 expref: 34 pid: 10450 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480808.197071:0:11544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11544:1869066311644032:192.168.204.51@tcp:104: 00000100:00100000:1.0:1782480808.197498:0:11544:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46016a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782480808.199401:0:11544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f3ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11544:1869066311644032:192.168.204.51@tcp:104: 00010000:00010000:2.0:1782480808.199429:0:11544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c02475d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480808.200912:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480808.201523:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291727872 00000100:00100000:2.0:1782480808.201534:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291727872 00000100:00100000:2.0:1782480808.201611:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:2.0:1782480808.201622:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+35:5581:x1869066291727872:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1782480808.201976:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+36:5581:x1869066291727872:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 354us (1071us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1782480808.201996:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:1.0:1782480808.212025:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480808.212151:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291728000 00000100:00100000:2.0:1782480808.212162:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291728000 00010000:00010000:2.0:1782480808.212203:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024702 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb10 expref: 36 pid: 10450 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480808.212288:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:2.0:1782480808.212299:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d684d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+36:2366:x1869066291728000:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480808.212319:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480808.212328:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024702 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb10 expref: 36 pid: 10450 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.212341:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024702 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb10 expref: 36 pid: 10450 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.212367:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024702 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb10 expref: 36 pid: 10450 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.212401:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62900) 00010000:00010000:2.0:1782480808.212406:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c02475d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.212417:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c02475d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.212425:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c02475d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.212463:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480808.212526:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d684d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+35:2366:x1869066291728000:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 228us (509us total) trans 0 rc 0/0 00010000:00010000:1.0:1782480808.212532:0:11544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c02475d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480808.212537:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 75 00010000:00010000:1.0:1782480808.212547:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c02475d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.212579:0:11544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c02475d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.212587:0:11544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c02475d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.212594:0:11544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c02475d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.212609:0:11544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480808.212613:0:11544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c02475d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.212620:0:11544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c02475d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.212631:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62900) 00010000:00010000:1.0:1782480808.212634:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782480808.212638:0:11544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c02475d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.212644:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c02475d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480808.212693:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+34:11547:x1869066291727616:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 15821us (16116us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480808.212703:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 196 00000100:00100000:3.0:1782480808.215899:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480808.216011:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291728256 00000100:00100000:0.0:1782480808.216020:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291728256 00000100:00100000:0.0:1782480808.216082:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:0.0:1782480808.216092:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+34:11547:x1869066291728256:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1782480808.216346:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+35:11547:x1869066291728256:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 255us (455us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1782480808.216354:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:3.0:1782480808.321112:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480808.321358:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291728512 00000100:00100000:2.0:1782480808.321379:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291728512 00000100:00100000:2.0:1782480808.321471:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 197 00000100:00100000:2.0:1782480808.321482:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+35:11558:x1869066291728512:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:2.0:1782480808.321506:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480808.321526:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024764 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb2c expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.321597:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c02476b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.321612:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c02476b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.321624:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c02476b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.321638:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024772 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.321644:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.321651:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.322354:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024779 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.322367:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.322374:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480808.322392:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1782480808.322483:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c02476b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.322492:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c02476b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.322498:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c02476b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.322504:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480808.322508:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c02476b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.322514:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c02476b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.322525:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:2.0:1782480808.322528:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480808.322532:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c02476b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.322537:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c02476b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.322548:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.322553:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024772 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.322569:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.322574:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480808.322578:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.322583:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024772 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.322591:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d45d62b00) 00010000:00010000:2.0:1782480808.322593:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480808.322596:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024772 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.322601:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024772 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.322646:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024764 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb2c expref: 38 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.322660:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024779 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb2c expref: 37 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.322667:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62900) 00010000:00010000:2.0:1782480808.322669:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782480808.322671:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e8400, rc 0) 00000100:00100000:2.0:1782480808.322842:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+37:11558:x1869066291728512:12345-192.168.204.51@tcp:101:cat.0 Request processed in 1359us (1736us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1782480808.322860:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 197 00000100:00100000:1.0:1782480808.329659:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480808.329804:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291728768 00000100:00100000:0.0:1782480808.329813:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291728768 00000100:00100000:0.0:1782480808.329873:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:0.0:1782480808.329882:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+37:11558:x1869066291728768:12345-192.168.204.51@tcp:35:cat.0 00000100:00100000:0.0:1782480808.330431:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+38:11558:x1869066291728768:12345-192.168.204.51@tcp:35:cat.0 Request processed in 547us (777us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1782480808.330456:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:0.0:1782480808.354810:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480808.355077:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291729024 00000100:00100000:2.0:1782480808.355086:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291729024 00000100:00100000:2.0:1782480808.355149:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 198 00000100:00100000:2.0:1782480808.355159:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+38:11559:x1869066291729024:12345-192.168.204.51@tcp:36:rm.0 00010000:00010000:2.0:1782480808.355233:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782480808.355262:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024779 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb2c expref: 38 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.355284:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d400/0x3dc3ebf33c02474f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb25 expref: 37 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.355298:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c024717 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb17 expref: 36 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.355310:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62900) 00010000:00010000:2.0:1782480808.355321:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782480808.355340:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024787 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.355353:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024787 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.355362:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024787 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.355381:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02478e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.355406:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02478e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.355413:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02478e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.356469:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024795 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.356483:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024795 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.356493:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024795 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782480808.357880:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1782480808.358005:0:5808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 429199256768ns, next at 430199252895ns, rc = 0 00010000:00010000:2.0:1782480808.358083:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02479c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.358097:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02479c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.358107:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02479c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.358116:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02479c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.358122:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02479c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.358213:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02479c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.358303:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782480808.358329:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024795 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.358335:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024795 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.358341:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024795 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.358346:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480808.358350:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024795 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.358356:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024795 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.358368:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62800) 00010000:00010000:2.0:1782480808.358371:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782480808.358375:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024795 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.358381:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024795 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.358399:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024787 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.358405:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024787 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.358417:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024787 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.358423:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8a00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480808.358425:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024787 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.358432:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024787 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.358440:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:2.0:1782480808.358442:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480808.358445:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024787 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.358450:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8a00/0x3dc3ebf33c024787 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480808.358460:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005b879f56 reply state 0000000023d2a801 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02478e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480808.358469:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782480808.358636:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+37:11559:x1869066291729024:12345-192.168.204.51@tcp:36:rm.0 Request processed in 3455us (3813us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1782480808.358646:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 198 00010000:00010000:0.0:1782480808.359364:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480808.359372:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02479c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.359380:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9200 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:0.0:1782480808.359383:0:7486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02479c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.359390:0:7486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02479c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.359400:0:7486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b6d45d62800) 00010000:00010000:0.0:1782480808.359403:0:7486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782480808.359406:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02479c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.359412:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02479c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.359437:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480808.359439:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480808.359441:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480808.364861:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02478e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.365107:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02478e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.365117:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02478e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.365139:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480808.365144:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02478e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.365152:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02478e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.365169:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d45d62b00) 00010000:00010000:0.0:1782480808.365173:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480808.365177:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02478e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.365184:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02478e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480808.453694:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480808.453823:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291729280 00000100:00100000:1.0:1782480808.453834:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291729280 00000100:00100000:1.0:1782480808.453906:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 199 00000100:00100000:1.0:1782480808.453916:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+36:11565:x1869066291729280:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1782480808.453943:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480808.453965:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c0247a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb33 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.454104:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0247aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.454132:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0247aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.454144:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0247aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.454158:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0247b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.454165:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0247b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.454172:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0247b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782480808.454832:0:11544:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1782480808.455009:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0247b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.455021:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0247b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.455030:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0247b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.455067:0:11544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0247aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.455074:0:11544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0247aa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.455082:0:11544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0247aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.455096:0:11544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480808.455100:0:11544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0247aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.455107:0:11544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0247aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.455121:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:1.0:1782480808.455124:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480808.455129:0:11544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0247aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.455136:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0247aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782480808.455152:0:11544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad4786cc reply state 000000001044349b transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0247b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480808.455161:0:11544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782480808.455193:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c0247a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb33 expref: 39 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.455208:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0247b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb33 expref: 38 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.455214:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:1.0:1782480808.455216:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782480808.455218:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573600, rc 0) 00000100:00100000:1.0:1782480808.455306:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+39:11565:x1869066291729280:12345-192.168.204.51@tcp:101:bash.0 Request processed in 1391us (1622us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1782480808.455320:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 199 00010000:00010000:3.0:1782480808.458575:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0247b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.458592:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0247b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.458600:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0247b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.458606:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480808.458633:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0247b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.458641:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0247b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.458657:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d5230f800) 00010000:00010000:3.0:1782480808.458660:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480808.458665:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0247b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.458671:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c0247b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480808.459648:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480808.460566:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291729408 00000100:00100000:3.0:1782480808.460577:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291729408 00000100:00100000:3.0:1782480808.460655:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:3.0:1782480808.460665:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2367:x1869066291729408:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1782480808.460683:0:6604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480808.460702:0:6604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022db9cd1/0x3dc3ebf33c0247c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb3a expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782480808.460726:0:6604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782480808.460764:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=429s v=(0 0) 00010000:00010000:3.0:1782480808.460769:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480808.460778:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022db9cd1/0x3dc3ebf33c0247c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb3a expref: 6 pid: 6604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.460796:0:6604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000022db9cd1/0x3dc3ebf33c0247c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb3a expref: 6 pid: 6604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.460823:0:6604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d82165e00, rc 0) 00000100:00100000:3.0:1782480808.460881:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2367:x1869066291729408:12345-192.168.204.51@tcp:101:bash.0 Request processed in 218us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480808.460888:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00080000:0.0:1782480808.461179:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480808.463713:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480808.463823:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291729536 00000100:00100000:2.0:1782480808.463833:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291729536 00000100:00100000:2.0:1782480808.463896:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:2.0:1782480808.463906:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+6:11565:x1869066291729536:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1782480808.463951:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480808.463970:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c0247cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb41 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.464013:0:6602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000022db9cd1/0x3dc3ebf33c0247c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb3a expref: 7 pid: 6604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.464022:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480808.464026:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480808.464030:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c0247cd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb41 expref: 7 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.464064:0:6602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000022db9cd1/0x3dc3ebf33c0247c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb3a expref: 7 pid: 6604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.464078:0:6602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000022db9cd1/0x3dc3ebf33c0247c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb3a expref: 7 pid: 6604 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480808.464093:0:6602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f1c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6602:1869066311644160:192.168.204.51@tcp:104: 00000100:00100000:2.0:1782480808.464189:0:6602:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d756260c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480808.467344:0:6602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f1c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6602:1869066311644160:192.168.204.51@tcp:104: 00010000:00010000:2.0:1782480808.467383:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c0247cd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb41 expref: 7 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.467404:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9400, rc 0) 00000100:00100000:2.0:1782480808.467501:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+7:11565:x1869066291729536:12345-192.168.204.51@tcp:101:bash.0 Request processed in 3595us (3796us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480808.467511:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:0.0:1782480808.468164:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480808.469569:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291729664 00000100:00100000:3.0:1782480808.469583:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291729664 00010000:00010000:3.0:1782480808.469634:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000022db9cd1/0x3dc3ebf33c0247c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb3a expref: 7 pid: 6604 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480808.469742:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:3.0:1782480808.469769:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2367:x1869066291729664:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480808.469785:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480808.469806:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000022db9cd1/0x3dc3ebf33c0247c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb3a expref: 7 pid: 6604 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.469819:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000022db9cd1/0x3dc3ebf33c0247c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb3a expref: 7 pid: 6604 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.469842:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022db9cd1/0x3dc3ebf33c0247c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb3a expref: 7 pid: 6604 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.469858:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480808.469862:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480808.469870:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c0247cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb41 expref: 6 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.469894:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c0247cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb41 expref: 6 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.469931:0:5792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c0247cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb41 expref: 6 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480808.469959:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fe71180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5792:1869066311644288:192.168.204.51@tcp:105: 00000100:00100000:3.0:1782480808.470060:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46a5b900 going to sleep for 11 seconds 00000100:00100000:3.0:1782480808.477699:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480808.478084:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291729920 00000100:00100000:1.0:1782480808.478094:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291729920 00000100:00100000:1.0:1782480808.478161:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:1.0:1782480808.478171:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+38:11565:x1869066291729920:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:2.0:1782480808.478466:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fe71180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5792:1869066311644288:192.168.204.51@tcp:105: 00010000:00010000:2.0:1782480808.478488:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480808.478539:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2367:x1869066291729664:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 8772us (10376us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480808.478549:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:1.0:1782480808.479803:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+39:11565:x1869066291729920:12345-192.168.204.51@tcp:35:bash.0 Request processed in 1628us (2108us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1782480808.479812:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 55 00010000:00010000:2.0:1782480808.631327:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480808.692360:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480808.692483:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291730048 00000100:00100000:2.0:1782480808.692494:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291730048 00000100:00100000:2.0:1782480808.692560:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 200 00000100:00100000:2.0:1782480808.692570:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+39:11581:x1869066291730048:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1782480808.692600:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480808.692622:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0247d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb48 expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.692705:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0247db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.692721:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0247db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.692731:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0247db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480808.692825:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1782480808.692829:0:10450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480808.692850:0:10450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0247db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.692907:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0247d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb48 expref: 41 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.692926:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0247db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb48 expref: 40 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.692935:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:2.0:1782480808.692938:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782480808.692941:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9e00, rc 0) 00000100:00100000:2.0:1782480808.693015:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+40:11581:x1869066291730048:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 445us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480808.693022:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 200 00000100:00100000:3.0:1782480808.697073:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782480808.697097:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f1c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311644416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480808.697166:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480808.698381:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311644416 00000100:00100000:2.0:1782480808.698391:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311644416 00000100:00100000:2.0:1782480808.698462:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782480808.698471:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311644416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782480808.698506:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480808.698565:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311644416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480808.698572:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782480808.698621:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f1c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311644416:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782480808.699262:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480808.713474:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480808.713585:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291730304 00000100:00100000:0.0:1782480808.713596:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291730304 00000100:00100000:0.0:1782480808.713660:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 201 00000100:00100000:0.0:1782480808.713670:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+40:11581:x1869066291730304:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1782480808.713702:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480808.713727:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c0247e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb4f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.713879:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0247e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.714063:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0247e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.714076:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0247e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480808.714090:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1782480808.714301:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c0247e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb4f expref: 43 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.714322:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0247e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb4f expref: 42 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.714331:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:0.0:1782480808.714334:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782480808.714338:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2d000, rc 0) 00000100:00100000:0.0:1782480808.714406:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+42:11581:x1869066291730304:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 737us (941us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1782480808.714414:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 201 00000100:00100000:3.0:1782480808.721840:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480808.721895:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480808.721998:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291730688 00000100:00100000:0.0:1782480808.722006:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291730432 00000100:00100000:2.0:1782480808.722007:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291730688 00000100:00100000:0.0:1782480808.722014:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291730432 00000100:00100000:0.0:1782480808.722075:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:2.0:1782480808.722077:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 202 00000100:00100000:2.0:1782480808.722092:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+43:11581:x1869066291730688:12345-192.168.204.51@tcp:101:lfs.0 00000100:00100000:0.0:1782480808.722092:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+43:2367:x1869066291730432:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480808.722114:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480808.722146:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480808.722153:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0247e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb4f expref: 43 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.722164:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0247f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb56 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.722174:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:0.0:1782480808.722182:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480808.722241:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+43:2367:x1869066291730432:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 156us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480808.722248:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00010000:00010000:2.0:1782480808.722274:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0247fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.722288:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0247fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.722297:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0247fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480808.722310:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1782480808.722434:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c0247f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb56 expref: 44 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.722449:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0247fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb56 expref: 43 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.722456:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:2.0:1782480808.722459:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782480808.722461:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e8400, rc 0) 00000100:00100000:2.0:1782480808.722485:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+43:11581:x1869066291730688:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 400us (600us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1782480808.722491:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 202 00000100:00100000:3.0:1782480808.733440:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480808.733589:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291730816 00000100:00100000:0.0:1782480808.733598:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291730816 00000100:00100000:0.0:1782480808.733660:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:0.0:1782480808.733671:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+6:2368:x1869066291730816:12345-192.168.204.51@tcp:1:lfs.0 00010000:00010000:0.0:1782480808.733727:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8478058/0x3dc3ebf33c02480c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.733781:0:6604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c0247cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb41 expref: 6 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.733790:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480808.733793:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782480808.733798:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8478058/0x3dc3ebf33c02480c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.733837:0:6604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c0247cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb41 expref: 6 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.733851:0:6604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c0247cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb41 expref: 6 pid: 6602 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480808.733877:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6604:1869066311644544:192.168.204.51@tcp:104: 00000100:00100000:0.0:1782480808.733979:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d47c789c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480808.736313:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6604:1869066311644544:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480808.736346:0:6604:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a8478058/0x3dc3ebf33c02480c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480808.740625:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480808.740851:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291730944 00000100:00100000:2.0:1782480808.740862:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291730944 00002000:00100000:2.0:1782480808.740911:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9b6d7fe72680 x1869066291730944/t0(0) o4->49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp:564/0 lens 504/0 e 0 to 0 dl 1782480819 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782480808.740934:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d7fe72680 with x1869066291730944 ext(0->8) 00010000:00010000:2.0:1782480808.740944:0:6610:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c0247cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb41 expref: 7 pid: 6602 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.740961:0:6610:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c0247cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb41 expref: 7 pid: 6602 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782480808.740982:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b6d7fe72680 00000100:00100000:2.0:1782480808.741017:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:2.0:1782480808.741027:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2366:x1869066291730944:12345-192.168.204.51@tcp:4:lfs.0 00000100:00100000:2.0:1782480808.741539:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+9:2366:x1869066291730944:12345-192.168.204.51@tcp:4:lfs.0 Request processed in 511us (922us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1782480808.741548:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00002000:00100000:2.0:1782480808.741556:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9b6d7fe72680 x1869066291730944/t4294967308(0) o4->49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp:564/0 lens 504/448 e 0 to 0 dl 1782480819 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782480808.741565:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d7fe72680 with x1869066291730944 ext(0->8) 00010000:00010000:2.0:1782480808.743360:0:6610:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c0247cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb41 expref: 9 pid: 6602 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.743395:0:6610:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c0247cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb41 expref: 9 pid: 6602 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782480808.743404:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b6d7fe72680 00000100:00100000:2.0:1782480808.745645:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480808.745784:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291731072 00000100:00100000:1.0:1782480808.745795:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291731072 00010000:00010000:1.0:1782480808.745839:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c0247cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb41 expref: 9 pid: 6602 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480808.745881:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:1.0:1782480808.745890:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+9:2368:x1869066291731072:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480808.745905:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1782480808.745926:0:8304:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1782480808.745929:0:8304:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782480808 00002000:00010000:1.0:1782480808.745931:0:8304:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1782480809 00002000:00010000:1.0:1782480808.745933:0:8304:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1782480808 00010000:00010000:1.0:1782480808.745938:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c0247cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb41 expref: 9 pid: 6602 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.745951:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c0247cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb41 expref: 9 pid: 6602 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.746001:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c0247cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb41 expref: 9 pid: 6602 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.746017:0:8304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782480808.746021:0:8304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782480808.746027:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8478058/0x3dc3ebf33c02480c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.746036:0:8304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8478058/0x3dc3ebf33c02480c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.746072:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480808.746136:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2368:x1869066291731072:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 247us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480808.746145:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 77 00010000:00010000:0.0:1782480808.746279:0:6604:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a8478058/0x3dc3ebf33c02480c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.746289:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8478058/0x3dc3ebf33c02480c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.746312:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8478058/0x3dc3ebf33c02480c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.746319:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8478058/0x3dc3ebf33c02480c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.746326:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8478058/0x3dc3ebf33c02480c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.746334:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2d000 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:0.0:1782480808.746338:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8478058/0x3dc3ebf33c02480c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.746359:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8478058/0x3dc3ebf33c02480c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.746372:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8478058/0x3dc3ebf33c02480c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.746379:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8478058/0x3dc3ebf33c02480c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480808.746427:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2368:x1869066291730816:12345-192.168.204.51@tcp:1:lfs.0 Request processed in 12758us (12995us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480808.746435:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:3.0:1782480808.756659:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480808.756790:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291731328 00000100:00100000:0.0:1782480808.756801:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291731328 00000100:00100000:0.0:1782480808.756859:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:0.0:1782480808.756870:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45d57050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+43:11581:x1869066291731328:12345-192.168.204.51@tcp:35:lfs.0 00000004:00010000:0.0:1782480808.756950:0:5811:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0247fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb56 expref: 43 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782480808.757402:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1782480808.757452:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1782480808.760842:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1782480808.760962:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024813 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.760994:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0247b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb33 expref: 47 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.761003:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024813 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.761046:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0247b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb33 expref: 47 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.761062:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0247b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb33 expref: 47 pid: 11544 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480808.761077:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f1c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5811:1869066311644672:192.168.204.51@tcp:104: 00000100:00100000:2.0:1782480808.761179:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75626cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480808.763831:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f1c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5811:1869066311644672:192.168.204.51@tcp:104: 00010000:00010000:2.0:1782480808.763864:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024813 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480808.764910:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480808.765251:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291731456 00000100:00100000:0.0:1782480808.765262:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291731456 00010000:00010000:0.0:1782480808.765311:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0247b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb33 expref: 48 pid: 11544 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480808.765379:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:0.0:1782480808.765390:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+48:2367:x1869066291731456:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480808.765407:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480808.765413:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0247b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb33 expref: 48 pid: 11544 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.765425:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0247b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb33 expref: 48 pid: 11544 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.765448:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573600/0x3dc3ebf33c0247b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb33 expref: 48 pid: 11544 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.765466:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:0.0:1782480808.765471:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024813 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.765481:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024813 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.765488:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024813 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480808.765523:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480808.765586:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+47:2367:x1869066291731456:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 198us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480808.765594:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 78 00010000:00010000:2.0:1782480808.766809:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024813 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.766823:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024813 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782480808.766985:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1782480808.767222:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1782480808.767367:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f1c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5811:1869066311644800:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782480808.767434:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480808.767472:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75626c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782480808.767812:0:5812:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311644800 00000100:00100000:0.0:1782480808.767826:0:5812:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311644800 00000100:00100000:0.0:1782480808.767874:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782480808.767884:0:5812:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5811:x1869066311644800:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782480808.767990:0:5812:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5811:x1869066311644800:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 107us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480808.767998:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782480808.769935:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f1c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5811:1869066311644800:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1782480808.770482:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1782480808.770572:0:5811:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f1c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5811:1869066311644928:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782480808.770654:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480808.770692:0:5811:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75626cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480808.771358:0:5812:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311644928 00000100:00100000:0.0:1782480808.771368:0:5812:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311644928 00000100:00100000:0.0:1782480808.771415:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782480808.771425:0:5812:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5811:x1869066311644928:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782480808.771652:0:5812:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5811:x1869066311644928:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 227us (996us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1782480808.771660:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782480808.771777:0:5811:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f1c0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5811:1869066311644928:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1782480808.771851:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1782480808.771907:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024813 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.771918:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024813 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.771925:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024813 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.771931:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480808.771936:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024813 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.771942:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024813 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.771958:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:2.0:1782480808.771961:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1782480808.771965:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024813 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.771991:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024813 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782480808.772500:0:5811:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1782480808.772595:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1782480808.772607:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 429613859411ns, next at 430613857279ns, rc = 0 00000001:00080000:2.0:1782480808.772615:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1782480808.772651:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:2.0:1782480808.772654:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782480808.772662:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c0247fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb56 expref: 51 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480808.773030:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45d57050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+50:11581:x1869066291731328:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 16160us (16381us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1782480808.773039:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00000020:00080000:2.0:1782480808.773045:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1782480808.777044:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480808.777137:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291731584 00000100:00100000:1.0:1782480808.777150:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291731584 00000100:00100000:1.0:1782480808.777206:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 203 00000100:00100000:1.0:1782480808.777217:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+50:11581:x1869066291731584:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1782480808.777252:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480808.777278:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c02481a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb5d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.777342:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c02481a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb5d expref: 51 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.777377:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c02481a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb5d expref: 51 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480808.777398:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:1.0:1782480808.777401:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782480808.777405:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572000, rc 0) 00000100:00100000:1.0:1782480808.778079:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+51:11581:x1869066291731584:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 861us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480808.778087:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 203 00000100:00100000:3.0:1782480808.781428:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480808.781526:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291731840 00000100:00100000:1.0:1782480808.781536:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291731840 00000100:00100000:1.0:1782480808.781598:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:1.0:1782480808.781608:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+51:11581:x1869066291731840:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1782480808.781857:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+52:11581:x1869066291731840:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 248us (436us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1782480808.781864:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:0.0:1782480808.871518:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480808.871631:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291731968 00000100:00100000:2.0:1782480808.871641:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291731968 00000100:00100000:2.0:1782480808.871705:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 204 00000100:00100000:2.0:1782480808.871715:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+52:11591:x1869066291731968:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:2.0:1782480808.871830:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024821 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.871848:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024821 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.871860:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024821 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.871896:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024828 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.871905:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.871912:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872036:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02482f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872044:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02482f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872051:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02482f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480808.872092:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02482f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872105:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024821 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872111:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024821 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872128:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024821 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872134:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480808.872138:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024821 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872153:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024821 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872165:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:2.0:1782480808.872168:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480808.872173:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024821 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872180:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024821 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872195:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872201:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024828 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872206:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024828 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872211:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480808.872214:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024828 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872220:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024828 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872227:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d45d62900) 00010000:00010000:2.0:1782480808.872239:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480808.872242:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024828 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872259:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024828 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872275:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02482f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872281:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02482f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872286:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02482f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872291:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480808.872294:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02482f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872300:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02482f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872308:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:2.0:1782480808.872310:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480808.872313:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02482f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.872318:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02482f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480808.872390:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+52:11591:x1869066291731968:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 676us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480808.872399:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 204 00000100:00100000:2.0:1782480808.921500:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480808.921644:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291732224 00000100:00100000:3.0:1782480808.921655:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291732224 00000100:00100000:3.0:1782480808.921717:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 205 00000100:00100000:3.0:1782480808.921726:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+52:11594:x1869066291732224:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1782480808.921787:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480808.921806:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024836 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb64 expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.921874:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c02483d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.921908:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c02483d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.921920:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c02483d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.921943:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024844 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.921950:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.921957:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.922090:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c02484b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.922098:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c02484b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.922105:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c02484b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480808.922116:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1782480808.922220:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c02483d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.922228:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c02483d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.922234:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c02483d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.922240:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d82165e00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480808.922246:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c02483d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.922253:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c02483d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.922265:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:3.0:1782480808.922268:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480808.922274:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c02483d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.922279:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c02483d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.922293:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.922300:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024844 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.922306:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024844 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.922320:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d82165200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480808.922323:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024844 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.922329:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024844 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.922337:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d4bddce00) 00010000:00010000:3.0:1782480808.922339:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480808.922342:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024844 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.922348:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024844 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.922405:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024836 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb64 expref: 55 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.922423:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c02484b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb64 expref: 54 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480808.922430:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:3.0:1782480808.922432:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480808.922434:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d82164000, rc 0) 00000100:00100000:3.0:1782480808.922846:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+54:11594:x1869066291732224:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1117us (1353us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1782480808.922855:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 205 00000100:00100000:0.0:1782480808.929187:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480808.929323:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291732352 00000100:00100000:1.0:1782480808.929334:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291732352 00000100:00100000:2.0:1782480808.929497:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 206 00000100:00100000:2.0:1782480808.929510:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+54:11594:x1869066291732352:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:2.0:1782480808.929587:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024859 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.929607:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.929619:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.929651:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.929657:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024859 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.929663:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024859 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.929669:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480808.929673:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024859 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.929680:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024859 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.929691:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:2.0:1782480808.929695:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782480808.929700:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024859 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480808.929726:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c024859 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480808.929862:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+54:11594:x1869066291732352:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 354us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480808.929870:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 206 00000100:00100000:0.0:1782480808.933797:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480808.933923:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291732608 00000100:00100000:1.0:1782480808.933943:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291732608 00000100:00100000:1.0:1782480808.934008:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:1.0:1782480808.934017:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+54:11594:x1869066291732608:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1782480808.934269:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+55:11594:x1869066291732608:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 251us (521us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1782480808.934277:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:0.0:1782480809.021625:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480809.021724:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291732864 00000100:00100000:3.0:1782480809.021785:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291732864 00000100:00100000:3.0:1782480809.021872:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 207 00000100:00100000:3.0:1782480809.021884:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+55:11604:x1869066291732864:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1782480809.021930:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480809.022217:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782480809.022259:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9e00/0x3dc3ebf33c0247db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb48 expref: 55 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.022280:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:3.0:1782480809.022286:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782480809.022300:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024860 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb6b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.022546:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024867 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.022562:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c02484b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb64 expref: 55 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.022570:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024867 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.022605:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c02484b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb64 expref: 55 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.022619:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c02484b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb64 expref: 55 pid: 10450 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480809.022633:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fe73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1869066311645056:192.168.204.51@tcp:104: 00000100:00080000:0.0:1782480809.022860:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480809.023053:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46a5bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782480809.030715:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480809.031606:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291732992 00000100:00100000:1.0:1782480809.031618:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291732992 00010000:00010000:1.0:1782480809.031676:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c02484b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb64 expref: 56 pid: 10450 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480809.031725:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:1.0:1782480809.031735:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+56:2367:x1869066291732992:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480809.031793:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480809.031802:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c02484b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb64 expref: 56 pid: 10450 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480809.031816:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c02484b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb64 expref: 56 pid: 10450 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480809.031840:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:1.0:1782480809.031845:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024867 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480809.031854:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024867 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480809.031861:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024867 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480809.031879:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480809.032355:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+56:2367:x1869066291732992:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 618us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480809.032365:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 79 00010000:00010000:3.0:1782480809.034014:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c02484b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb64 expref: 55 pid: 10450 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480809.034043:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fe73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1869066311645056:192.168.204.51@tcp:104: 00010000:00010000:3.0:1782480809.034067:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024867 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.034077:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024867 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.034083:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024867 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480809.034105:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1782480809.034285:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024860 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb6b expref: 56 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.034301:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024867 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb6b expref: 55 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.034310:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:3.0:1782480809.034313:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782480809.034316:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d82165200, rc 0) 00000100:00100000:3.0:1782480809.034449:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+55:11604:x1869066291732864:12345-192.168.204.51@tcp:101:bash.0 Request processed in 12567us (12833us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1782480809.034458:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 207 00000100:00100000:0.0:1782480809.039660:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480809.039885:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291733248 00000100:00100000:3.0:1782480809.040041:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291733248 00000100:00100000:3.0:1782480809.040244:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 208 00000100:00100000:3.0:1782480809.040257:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+55:11604:x1869066291733248:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:3.0:1782480809.040564:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c024875 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.040582:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c024875 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.040593:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c024875 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782480809.040643:0:10450:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1782480809.040669:0:10450:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000df08d279 reply state 00000000983ed903 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c024875 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480809.040678:0:10450:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782480809.040825:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+58:11604:x1869066291733248:12345-192.168.204.51@tcp:36:bash.0 Request processed in 570us (1175us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1782480809.040833:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 208 00000020:00080000:3.0:1782480809.040839:0:10450:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1782480809.048629:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480809.048674:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480809.048706:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480809.048735:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480809.048866:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291733504 00000100:00100000:3.0:1782480809.048876:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291733504 00000100:00100000:3.0:1782480809.048951:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 298 00000100:00100000:3.0:1782480809.048972:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2366:x1869066291733504:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480809.049048:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2366:x1869066291733504:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 88us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480809.049056:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 298 00000100:00100000:3.0:1782480809.049104:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291733376 00000100:00100000:3.0:1782480809.049127:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291733376 00000100:00100000:3.0:1782480809.049154:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291733760 00000100:00100000:3.0:1782480809.049157:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291733760 00000100:00100000:3.0:1782480809.049186:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 159 00000100:00100000:3.0:1782480809.049193:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291733760:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480809.049458:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2366:x1869066291733760:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 34us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480809.049465:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 159 00000100:00100000:3.0:1782480809.049480:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 209 00000100:00100000:3.0:1782480809.049487:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+58:11604:x1869066291733376:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1782480809.049502:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480809.049521:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c02487c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb72 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.049611:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024883 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.049625:0:11544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024867 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb6b expref: 59 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.049634:0:11544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c024875 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.049641:0:11544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024883 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.049659:0:11544:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c024875 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.049693:0:11544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024867 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb6b expref: 59 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.049706:0:11544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024867 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb6b expref: 59 pid: 5807 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480809.049719:0:11544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fe73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11544:1869066311645184:192.168.204.51@tcp:104: 00000100:00100000:3.0:1782480809.049870:0:11544:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46a5bcc0 going to sleep for 11 seconds 00000100:00080000:3.0:1782480809.049890:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480809.050053:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291733632 00000100:00100000:0.0:1782480809.050057:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291733632 00000100:00100000:0.0:1782480809.050090:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 93 00000100:00100000:0.0:1782480809.050097:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+9:2366:x1869066291733632:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480809.050147:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+9:2366:x1869066291733632:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 50us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480809.050155:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 93 00000100:00100000:1.0:1782480809.054705:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480809.055206:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291733888 00000100:00100000:0.0:1782480809.055215:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291733888 00010000:00010000:0.0:1782480809.055264:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024867 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb6b expref: 60 pid: 5807 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480809.055301:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:0.0:1782480809.055309:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+60:2367:x1869066291733888:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480809.055323:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480809.055330:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024867 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb6b expref: 60 pid: 5807 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480809.055343:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024867 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb6b expref: 60 pid: 5807 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480809.055366:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:0.0:1782480809.055371:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024883 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480809.055380:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024883 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480809.055531:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024883 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480809.055540:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782480809.055737:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024867 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb6b expref: 60 pid: 5807 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480809.055790:0:11544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fe73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11544:1869066311645184:192.168.204.51@tcp:104: 00010000:00010000:3.0:1782480809.055812:0:11544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024883 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480809.055862:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+59:2367:x1869066291733888:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 553us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480809.055871:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 80 00010000:00010000:2.0:1782480809.056356:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c024875 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480809.056366:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c024875 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480809.056373:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c024875 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480809.056379:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d82165e00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480809.056383:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c024875 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480809.056399:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c024875 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480809.056411:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:2.0:1782480809.056414:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480809.056417:0:3302:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024883 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480809.056425:0:3302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024883 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480809.056432:0:3302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024883 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480809.056470:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c024875 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480809.056477:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c024875 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.056588:0:11544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024883 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.056595:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024883 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480809.056639:0:11544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1782480809.056643:0:11544:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480809.056661:0:11544:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024883 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.056692:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c02487c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb72 expref: 58 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.056714:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024883 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb72 expref: 57 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.056721:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:3.0:1782480809.056723:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480809.056726:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d82164000, rc 0) 00000100:00100000:3.0:1782480809.056810:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+57:11604:x1869066291733376:12345-192.168.204.51@tcp:101:bash.0 Request processed in 7323us (8190us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480809.056818:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 209 00000100:00100000:0.0:1782480809.061497:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480809.061640:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291734144 00000100:00100000:1.0:1782480809.061651:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291734144 00000100:00100000:1.0:1782480809.061707:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:1.0:1782480809.061717:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+57:11604:x1869066291734144:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:1.0:1782480809.062585:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+58:11604:x1869066291734144:12345-192.168.204.51@tcp:35:bash.0 Request processed in 866us (1094us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1782480809.062596:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:1.0:1782480809.144143:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480809.144250:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291734272 00000100:00100000:3.0:1782480809.144261:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291734272 00000100:00100000:3.0:1782480809.144326:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 210 00000100:00100000:3.0:1782480809.144337:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+58:11610:x1869066291734272:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1782480809.144361:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480809.144380:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c02488a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb79 expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.144460:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024891 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.144475:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.144486:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480809.144548:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1782480809.144565:0:10450:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480809.144593:0:10450:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.144618:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c02488a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb79 expref: 60 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.144638:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024891 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb79 expref: 59 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.144646:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:3.0:1782480809.144650:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782480809.144653:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d82165200, rc 0) 00000100:00100000:3.0:1782480809.144720:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+59:11610:x1869066291734272:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 385us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480809.144727:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 210 00000100:00100000:2.0:1782480809.150855:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480809.151146:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291734400 00000100:00100000:3.0:1782480809.151158:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291734400 00000100:00100000:3.0:1782480809.151219:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 211 00000100:00100000:3.0:1782480809.151239:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+59:11610:x1869066291734400:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1782480809.151260:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480809.151278:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024898 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb80 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151342:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c02489f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151358:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c02489f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151388:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c02489f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151405:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0248a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151413:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0248a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151419:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0248a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151515:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c0248ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151524:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c0248ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151530:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c0248ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480809.151565:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1782480809.151570:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480809.151588:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c0248ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151599:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c0248ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151607:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c02489f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151624:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c02489f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151631:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c02489f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151637:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d82165e00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480809.151641:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c02489f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151648:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c02489f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151660:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:3.0:1782480809.151662:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480809.151667:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c02489f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151672:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165e00/0x3dc3ebf33c02489f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151686:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0248a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151692:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0248a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151697:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0248a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151702:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ec800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480809.151710:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0248a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151716:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0248a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151723:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d4bddce00) 00010000:00010000:3.0:1782480809.151725:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480809.151728:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0248a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151734:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0248a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151825:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c024898 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb80 expref: 61 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151841:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c0248ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb80 expref: 60 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.151849:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:3.0:1782480809.151851:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480809.151854:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ecc00, rc 0) 00000100:00100000:3.0:1782480809.152405:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+60:11610:x1869066291734400:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1164us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480809.152414:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 211 00000100:00100000:1.0:1782480809.156950:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480809.157006:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480809.157154:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291734656 00000100:00100000:3.0:1782480809.157164:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291734656 00000100:00100000:3.0:1782480809.157221:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 212 00000100:00100000:3.0:1782480809.157243:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+60:11610:x1869066291734656:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1782480809.157286:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480809.157310:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c0248b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb87 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.157414:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0248bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.157429:0:11544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024883 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb72 expref: 61 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.157436:0:11544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c0248ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb80 expref: 61 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.157444:0:11544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0248bb lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.157481:0:11544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c0248ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb80 expref: 61 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.157494:0:11544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c0248ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb80 expref: 61 pid: 5808 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480809.157509:0:11544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fe73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11544:1869066311645312:192.168.204.51@tcp:104: 00010000:00010000:3.0:1782480809.157624:0:11544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024883 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb72 expref: 61 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.157634:0:11544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024883 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb72 expref: 61 pid: 11544 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480809.157656:0:11544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fe71180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11544:1869066311645440:192.168.204.51@tcp:104: 00000100:00100000:3.0:1782480809.157681:0:11544:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46a5b900 going to sleep for 11 seconds 00000100:00100000:2.0:1782480809.158158:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291734784 00000100:00100000:2.0:1782480809.158166:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291734784 00010000:00010000:2.0:1782480809.158198:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c0248ad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb80 expref: 62 pid: 5808 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480809.158242:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00100000:2.0:1782480809.158250:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d684d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+62:2367:x1869066291734784:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480809.158263:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480809.158269:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c0248ad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb80 expref: 62 pid: 5808 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480809.158281:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c0248ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb80 expref: 62 pid: 5808 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480809.158299:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:2.0:1782480809.158305:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0248bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480809.158312:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0248bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480809.158330:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480809.158361:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d684d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+62:2367:x1869066291734784:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 111us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480809.158369:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 81 00010000:00010000:3.0:1782480809.162729:0:11544:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.51@tcp) returned -22 from blocking AST (req@0000000065fdf51c x1869066311645312) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c0248ad lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb80 expref: 61 pid: 5808 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.162780:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c0248ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb80 expref: 61 pid: 5808 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480809.162795:0:11544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fe73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11544:1869066311645312:192.168.204.51@tcp:104: 00000100:00100000:3.0:1782480809.162809:0:11544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fe71180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11544:1869066311645440:192.168.204.51@tcp:104: 00010000:00010000:3.0:1782480809.162832:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:3.0:1782480809.162837:0:11544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0248bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.162847:0:11544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0248bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.162857:0:11544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0248bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480809.163087:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480809.163536:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291734912 00000100:00100000:2.0:1782480809.163543:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291734912 00010000:00010000:2.0:1782480809.163581:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024883 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb72 expref: 61 pid: 11544 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480809.163623:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:2.0:1782480809.163633:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+61:2366:x1869066291734912:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480809.163648:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480809.163653:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024883 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb72 expref: 61 pid: 11544 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480809.163664:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024883 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb72 expref: 61 pid: 11544 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480809.163685:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c024883 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb72 expref: 61 pid: 11544 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480809.163700:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:2.0:1782480809.163704:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0248bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480809.163711:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0248bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480809.163732:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0248bb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480809.163904:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480809.163972:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+60:2366:x1869066291734912:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 339us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480809.163980:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 82 00010000:00010000:3.0:1782480809.164126:0:11544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0248bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.164134:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0248bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480809.164164:0:11544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1782480809.164324:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c0248b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb87 expref: 61 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.164340:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0248bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb87 expref: 60 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.164348:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:3.0:1782480809.164350:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782480809.164353:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821eda00, rc 0) 00000100:00100000:3.0:1782480809.164381:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+60:11610:x1869066291734656:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 7140us (7444us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1782480809.164388:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 212 00000100:00100000:1.0:1782480809.168101:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480809.168537:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291735168 00000100:00100000:2.0:1782480809.168549:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291735168 00000100:00100000:2.0:1782480809.168659:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:2.0:1782480809.168670:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+60:11610:x1869066291735168:12345-192.168.204.51@tcp:103:lfs.0 00010000:00010000:2.0:1782480809.168689:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480809.168713:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c02481a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb5d expref: 60 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480809.168732:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:2.0:1782480809.168738:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480809.168832:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+59:11610:x1869066291735168:12345-192.168.204.51@tcp:103:lfs.0 Request processed in 163us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480809.168840:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:1.0:1782480809.172324:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480809.172723:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291735296 00000100:00100000:0.0:1782480809.172734:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291735296 00000100:00100000:0.0:1782480809.172824:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 213 00000100:00100000:0.0:1782480809.172835:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+59:11610:x1869066291735296:12345-192.168.204.51@tcp:58:lfs.0 00010000:00010000:0.0:1782480809.172951:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0248c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480809.172981:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0248c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480809.172994:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0248c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782480809.173194:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1782480809.173304:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+59:11610:x1869066291735296:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 468us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480809.173312:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 213 00000100:00100000:1.0:1782480809.176347:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480809.176488:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291735424 00000100:00100000:3.0:1782480809.176498:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291735424 00000100:00100000:3.0:1782480809.176561:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 214 00000100:00100000:3.0:1782480809.176571:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+59:11610:x1869066291735424:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1782480809.176593:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480809.176614:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c0248d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb8e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.176674:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0248c9 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.176685:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c0248d0 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb8e expref: 60 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.176719:0:5808:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0248c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.176731:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c0248d0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb8e expref: 60 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.176784:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:3.0:1782480809.176788:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782480809.176792:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c0248d0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb8e expref: 60 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480809.176800:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821edc00, rc 0) 00000100:00100000:3.0:1782480809.176852:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+60:11610:x1869066291735424:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 282us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480809.176859:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 214 00010000:00010000:3.0:1782480809.654986:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782480810.043130:0:11541:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782480810.043140:0:11541:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782480810.043178:0:11541:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1782480810.043184:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782480810.043300:0:11541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7591f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11541:1869066311645568:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782480810.043415:0:11541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46016900 going to sleep for 11 seconds 00000100:00100000:1.0:1782480810.048515:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480810.048713:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291735552 00000100:00100000:3.0:1782480810.048722:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291735552 00000100:00100000:3.0:1782480810.048825:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 215 00000100:00100000:3.0:1782480810.048836:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+61:11611:x1869066291735552:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782480810.048867:0:11544:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782480810.049001:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+61:11611:x1869066291735552:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 166us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480810.049011:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 215 00000100:00100000:0.0:1782480810.049789:0:11541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7591f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11541:1869066311645568:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782480810.055223:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480810.055447:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291735680 00000100:00100000:1.0:1782480810.055457:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291735680 00000100:00100000:1.0:1782480810.055518:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 216 00000100:00100000:1.0:1782480810.055538:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+60:11611:x1869066291735680:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1782480810.055615:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0248d7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055646:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0248d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055658:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0248d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055673:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c0248de lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055681:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c0248de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055688:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c0248de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055712:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0248e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055721:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0248e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055727:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0248e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480810.055808:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1782480810.055812:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782480810.055826:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0248e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055837:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0248d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055853:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0248d7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055860:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0248d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055866:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573a00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480810.055870:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0248d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055878:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0248d7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055905:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d4bddc700) 00010000:00010000:1.0:1782480810.055909:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480810.055913:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0248d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055919:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573a00/0x3dc3ebf33c0248d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055933:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c0248de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055939:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c0248de lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055957:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c0248de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055962:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573e00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480810.055972:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c0248de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055979:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c0248de lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055987:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9b6d5230f900) 00010000:00010000:1.0:1782480810.055990:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480810.055993:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c0248de lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.055999:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c0248de lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.056015:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0248e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.056021:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0248e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.056026:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0248e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.056032:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480810.056035:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0248e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.056040:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0248e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.056047:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:1.0:1782480810.056049:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480810.056059:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0248e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.056065:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c0248e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480810.056149:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+60:11611:x1869066291735680:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 Request processed in 612us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480810.056158:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 216 00000100:00100000:2.0:1782480810.062265:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480810.062515:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291735936 00000100:00100000:0.0:1782480810.062536:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291735936 00000100:00100000:0.0:1782480810.062597:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 217 00000100:00100000:0.0:1782480810.062607:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+60:11611:x1869066291735936:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782480810.062631:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480810.062650:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c0248ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb95 expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.063113:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0248f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.063130:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0248f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.063141:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0248f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480810.063153:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1782480810.063263:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0248f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.063271:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0248f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.063278:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0248f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.063283:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2d000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480810.063287:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0248f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.063294:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0248f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.063306:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:0.0:1782480810.063309:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782480810.063314:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0248f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.064999:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c0248f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.065059:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c0248ec lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb95 expref: 62 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.065071:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d4bddc700) 00010000:00010000:0.0:1782480810.065074:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782480810.065079:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c0248ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb95 expref: 62 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.065088:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2d600, rc 0) 00000100:00100000:0.0:1782480810.065168:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+61:11611:x1869066291735936:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 2562us (2913us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1782480810.065178:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 217 00000100:00100000:0.0:1782480810.081660:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480810.081844:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291736064 00000100:00100000:1.0:1782480810.081855:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291736064 00000100:00100000:1.0:1782480810.081998:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 218 00000100:00100000:1.0:1782480810.082009:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+61:11611:x1869066291736064:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782480810.082043:0:5807:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782480810.083486:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+61:11611:x1869066291736064:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 1468us (1824us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480810.083501:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 218 00000100:00100000:2.0:1782480810.097240:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480810.097348:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291736320 00000100:00100000:3.0:1782480810.097358:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291736320 00000100:00100000:3.0:1782480810.097438:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 219 00000100:00100000:3.0:1782480810.097449:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+61:11611:x1869066291736320:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480810.097471:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480810.097474:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782480810.097504:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c024891 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb79 expref: 61 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.097537:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:3.0:1782480810.097542:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782480810.097556:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c024901 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fb9c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782480810.098296:0:5808:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1782480810.099672:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c024908 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.099693:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c024908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.099704:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c024908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.100613:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c024901 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb9c expref: 63 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.100640:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c024908 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb9c expref: 62 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.100649:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d4bddce00) 00010000:00010000:3.0:1782480810.100664:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480810.100669:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d821ec800, rc 0) 00000100:00100000:3.0:1782480810.100895:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+62:11611:x1869066291736320:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 3434us (3652us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1782480810.100904:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 219 00000100:00100000:2.0:1782480810.113412:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480810.113694:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291736576 00000100:00100000:0.0:1782480810.113705:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291736576 00000100:00100000:0.0:1782480810.113820:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 220 00000100:00100000:0.0:1782480810.113831:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+62:11611:x1869066291736576:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782480810.113903:0:10450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480810.113935:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c024908 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb9c expref: 62 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.113968:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d4bddce00) 00010000:00010000:0.0:1782480810.113979:0:10450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480810.114016:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024916 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.114028:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024916 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.114036:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024916 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.114050:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02491d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x64631a6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.114056:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02491d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x64631a6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.114061:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02491d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x64631a6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.114136:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024916 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.114143:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024916 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.114150:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024916 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.114156:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2d000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480810.114161:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024916 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.114168:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024916 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.114187:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:0.0:1782480810.114190:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480810.114194:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024916 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.114200:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d000/0x3dc3ebf33c024916 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.114211:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02491d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x64631a6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.114217:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02491d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x64631a6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.114222:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02491d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x64631a6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.114227:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2cc00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480810.114229:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02491d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x64631a6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.114234:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02491d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x64631a6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.114239:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x64631a6b (ffff9b6d43255500) 00010000:00010000:0.0:1782480810.114242:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480810.114244:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02491d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x64631a6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.114249:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2cc00/0x3dc3ebf33c02491d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x64631a6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480810.114420:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+61:11611:x1869066291736576:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 588us (1033us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782480810.114429:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 220 00000100:00100000:0.0:1782480810.122491:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480810.122780:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291736704 00000100:00100000:1.0:1782480810.122790:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291736704 00000100:00100000:1.0:1782480810.122853:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 221 00000100:00100000:1.0:1782480810.122864:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+61:11611:x1869066291736704:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480810.122902:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480810.122928:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024924 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fba3 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.122974:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02492b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.122988:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02492b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.123011:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02492b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.123110:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024924 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fba3 expref: 63 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.123130:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02492b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fba3 expref: 62 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.123138:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:1.0:1782480810.123142:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782480810.123145:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573e00, rc 0) 00000100:00100000:1.0:1782480810.123413:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+62:11611:x1869066291736704:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 549us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480810.123421:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 221 00000100:00100000:2.0:1782480810.127231:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480810.127440:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291736960 00000100:00100000:3.0:1782480810.127452:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291736960 00000100:00100000:3.0:1782480810.127529:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 222 00000100:00100000:3.0:1782480810.127540:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+62:11611:x1869066291736960:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782480810.127639:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c024932 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.127656:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c024932 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.127667:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c024932 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782480810.127990:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1782480810.128000:0:5808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 430969251761ns, next at 431969249283ns, rc = 0 00000004:00010000:3.0:1782480810.128102:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004fdff662 reply state 00000000a078e01d transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c024932 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480810.128112:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782480810.128233:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+64:11611:x1869066291736960:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 692us (1024us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1782480810.128241:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 222 00010000:00010000:1.0:1782480810.130526:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c024932 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.130545:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c024932 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.130552:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c024932 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.130559:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ecc00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480810.130563:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c024932 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.130571:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c024932 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.130605:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:1.0:1782480810.130608:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782480810.130614:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c024932 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.130619:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c024932 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480810.135498:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480810.136014:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291737088 00000100:00100000:1.0:1782480810.136025:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291737088 00000100:00100000:1.0:1782480810.136080:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 223 00000100:00100000:1.0:1782480810.136090:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+63:11611:x1869066291737088:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480810.136114:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480810.136137:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024939 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fbaa expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.136200:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024939 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbaa expref: 64 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.136229:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024939 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbaa expref: 64 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.136314:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:1.0:1782480810.136345:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782480810.136349:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572400, rc 0) 00000100:00100000:1.0:1782480810.136425:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+64:11611:x1869066291737088:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 334us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480810.136444:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 223 00000100:00100000:3.0:1782480810.141409:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480810.141641:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291737216 00000100:00100000:1.0:1782480810.141651:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291737216 00000100:00100000:1.0:1782480810.141726:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:1.0:1782480810.141736:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+9:2366:x1869066291737216:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1782480810.142080:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+10:2366:x1869066291737216:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 344us (682us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1782480810.142089:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00080000:3.0:1782480810.142353:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782480810.163423:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480810.163644:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291737472 00000100:00100000:1.0:1782480810.163655:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291737472 00000100:00100000:1.0:1782480810.163718:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:1.0:1782480810.163728:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+64:11611:x1869066291737472:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782480810.164195:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+65:11611:x1869066291737472:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 467us (782us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1782480810.164211:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:2.0:1782480810.173860:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480810.175047:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291737728 00000100:00100000:3.0:1782480810.175061:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291737728 00000100:00100000:3.0:1782480810.175144:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 224 00000100:00100000:3.0:1782480810.175155:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+65:11611:x1869066291737728:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782480810.175285:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+65:11611:x1869066291737728:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 132us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480810.175294:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 224 00000100:00100000:2.0:1782480810.181733:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480810.186870:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291737856 00000100:00100000:0.0:1782480810.187037:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291737856 00000100:00100000:1.0:1782480810.187304:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 225 00000100:00100000:1.0:1782480810.187318:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+65:11611:x1869066291737856:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480810.187424:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480810.187448:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c024940 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fbb1 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.188305:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c024947 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.188447:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c024947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.188478:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c024947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480810.190500:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782480810.190725:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c024947 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.190802:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573800/0x3dc3ebf33c024940 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbb1 expref: 67 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.190826:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c024947 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbb1 expref: 66 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.190835:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:1.0:1782480810.190838:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1782480810.190841:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573200, rc 0) 00000100:00100000:1.0:1782480810.190912:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+66:11611:x1869066291737856:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 3596us (9188us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480810.190921:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 225 00000100:00100000:1.0:1782480810.200857:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480810.203375:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291737984 00000100:00100000:0.0:1782480810.203391:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291737984 00000100:00100000:0.0:1782480810.203464:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:0.0:1782480810.203475:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+10:2369:x1869066291737984:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782480810.203498:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480810.203653:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cc73a8e/0x3dc3ebf33c02494e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fbb8 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782480810.203683:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3e7faa, blocks: 0x1 00010000:00010000:0.0:1782480810.203702:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1782480810.203706:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480810.203715:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cc73a8e/0x3dc3ebf33c02494e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbb8 expref: 11 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.203734:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005cc73a8e/0x3dc3ebf33c02494e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbb8 expref: 11 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.203792:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2cc00, rc 0) 00000100:00100000:0.0:1782480810.203864:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+11:2369:x1869066291737984:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 390us (3017us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480810.203885:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:2.0:1782480810.207855:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480810.208745:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291738240 00000100:00100000:0.0:1782480810.208839:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291738240 00000100:00100000:0.0:1782480810.208950:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 226 00000100:00100000:0.0:1782480810.208960:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+66:11611:x1869066291738240:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782480810.209066:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+66:11611:x1869066291738240:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 107us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480810.209074:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 226 00000100:00100000:2.0:1782480810.215849:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480810.215961:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291738368 00000100:00100000:1.0:1782480810.215971:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291738368 00000100:00100000:1.0:1782480810.216034:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:1.0:1782480810.216044:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+11:11611:x1869066291738368:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480810.216061:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480810.216078:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088c997a4/0x3dc3ebf33c024955 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fbbf expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.216124:0:8678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005cc73a8e/0x3dc3ebf33c02494e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbb8 expref: 12 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.216133:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480810.216137:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480810.216141:0:8678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088c997a4/0x3dc3ebf33c024955 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbbf expref: 12 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.216172:0:8678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005cc73a8e/0x3dc3ebf33c02494e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbb8 expref: 12 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.216185:0:8678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005cc73a8e/0x3dc3ebf33c02494e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbb8 expref: 12 pid: 6605 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480810.216211:0:8678:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b2bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8678:1869066311645696:192.168.204.51@tcp:104: 00000100:00100000:1.0:1782480810.216294:0:8678:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46016000 going to sleep for 11 seconds 00000100:00100000:2.0:1782480810.219662:0:8678:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b2bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8678:1869066311645696:192.168.204.51@tcp:104: 00010000:00010000:2.0:1782480810.219699:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000088c997a4/0x3dc3ebf33c024955 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbbf expref: 12 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.219720:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573000, rc 0) 00000100:00100000:2.0:1782480810.219813:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+12:11611:x1869066291738368:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 3769us (3972us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480810.219823:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:2.0:1782480810.225479:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480810.225612:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291738496 00000100:00100000:3.0:1782480810.225623:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291738496 00010000:00010000:3.0:1782480810.225669:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005cc73a8e/0x3dc3ebf33c02494e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbb8 expref: 12 pid: 6605 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480810.225718:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 83 00000100:00100000:3.0:1782480810.225728:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+12:2367:x1869066291738496:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480810.225767:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480810.225790:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005cc73a8e/0x3dc3ebf33c02494e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbb8 expref: 12 pid: 6605 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.225805:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005cc73a8e/0x3dc3ebf33c02494e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbb8 expref: 12 pid: 6605 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.225827:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cc73a8e/0x3dc3ebf33c02494e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbb8 expref: 12 pid: 6605 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.225847:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480810.225851:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480810.225874:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088c997a4/0x3dc3ebf33c024955 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbbf expref: 11 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.225897:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088c997a4/0x3dc3ebf33c024955 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbbf expref: 11 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.225952:0:5793:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000088c997a4/0x3dc3ebf33c024955 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbbf expref: 11 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480810.225967:0:5793:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fe71180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5793:1869066311645824:192.168.204.51@tcp:105: 00000100:00100000:3.0:1782480810.226044:0:5793:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46a5b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480810.229296:0:5793:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fe71180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5793:1869066311645824:192.168.204.51@tcp:105: 00010000:00010000:0.0:1782480810.230983:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480810.231072:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+11:2367:x1869066291738496:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 5340us (5598us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480810.231087:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 83 00000100:00100000:1.0:1782480810.232602:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480810.232734:0:12383:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291738624 00000100:00100000:3.0:1782480810.232744:0:12383:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291738624 00002000:00100000:3.0:1782480810.232817:0:12383:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9b6d7b2bca80 x1869066291738624/t0(0) o4->49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp:566/0 lens 504/0 e 0 to 0 dl 1782480821 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782480810.232829:0:12383:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d7b2bca80 with x1869066291738624 ext(0->12) 00002000:00010000:3.0:1782480810.232835:0:12383:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d7b2bca80 00000100:00100000:3.0:1782480810.232865:0:12383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:3.0:1782480810.232874:0:12383:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+11:2367:x1869066291738624:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1782480810.233705:0:12383:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+13:2367:x1869066291738624:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 Request processed in 828us (1105us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1782480810.233715:0:12383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00002000:00100000:3.0:1782480810.233724:0:12383:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9b6d7b2bca80 x1869066291738624/t4294967320(0) o4->49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp:566/0 lens 504/448 e 0 to 0 dl 1782480821 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782480810.233734:0:12383:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d7b2bca80 with x1869066291738624 ext(0->12) 00002000:00010000:3.0:1782480810.233770:0:12383:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d7b2bca80 00000100:00100000:2.0:1782480810.238569:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480810.238730:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291738752 00000100:00100000:3.0:1782480810.238740:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291738752 00000100:00100000:3.0:1782480810.238825:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 227 00000100:00100000:3.0:1782480810.238833:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+66:11611:x1869066291738752:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1782480810.292891:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+66:11611:x1869066291738752:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 Request processed in 54049us (54323us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480810.292905:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 227 00000001:00080000:1.0:1782480810.293903:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000001:00080000:1.0:1782480810.293964:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1782480810.293992:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1782480810.294018:0:5829:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b6d75626c00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1782480810.294022:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9b6d80890000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d75626000 00000020:00080000:1.0:1782480810.294025:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9b6d80890600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d75932000 00000004:00080000:1.0:1782480810.294042:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1782480810.294083:0:5829:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b6d75626e40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1782480810.294086:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9b6d51f2da00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d75626900 00000020:00080000:1.0:1782480810.294088:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9b6d51f2db00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d7f20d000 00000004:00080000:1.0:1782480810.294484:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:1.0:1782480810.294523:0:5841:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1782480810.294705:0:5841:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1782480810.294811:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782480810.294828:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fe73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311645952:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782480810.294892:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480810.294969:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d757c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311646208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1782480810.295005:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480810.295026:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782480810.295031:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b2bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311646080:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782480810.295054:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480810.295081:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311645952 00000100:00100000:1.0:1782480810.295088:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311645952 00000100:00100000:1.0:1782480810.297897:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311646208 00000100:00100000:1.0:1782480810.297906:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311646208 00000100:00100000:1.0:1782480810.297925:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311646080 00000100:00100000:1.0:1782480810.297928:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311646080 00000100:00100000:1.0:1782480810.297955:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782480810.297967:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1869066311645952:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1782480810.298058:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782480810.298062:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1782480810.298115:0:6605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1782480810.298152:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a3e7fa8, atime: 0x6a3e7fa9, ctime: 0x6a3e7fa8, blocks: 0x1 00010000:00010000:1.0:1782480810.298161:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dfae7c3/0x3dc3ebf33c02495c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.298194:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1782480810.298198:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480810.298273:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dfae7c3/0x3dc3ebf33c02495c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.298288:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006dfae7c3/0x3dc3ebf33c02495c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.298297:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dfae7c3/0x3dc3ebf33c02495c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.298304:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006dfae7c3/0x3dc3ebf33c02495c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.298431:0:6605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782480810.299106:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1869066311645952:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1137us (4210us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1782480810.299115:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782480810.299141:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782480810.299150:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3318:x1869066311646208:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1782480810.299339:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d7fe73b80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1782480810.299346:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fe73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311645952:0@lo:6:osp-syn-0-0.0 00002000:00010000:1.0:1782480810.299466:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1782480810.299470:0:6605:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1782480810 00002000:00010000:1.0:1782480810.299473:0:6605:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782480810.299475:0:6605:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1782480810 -> 1782480810 00002000:00010000:1.0:1782480810.299477:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782480810.299571:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3318:x1869066311646208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 422us (4564us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1782480810.299578:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782480810.299591:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782480810.299597:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3318:x1869066311646080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1782480810.299613:0:6605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1782480810.299627:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097bc3f61/0x3dc3ebf33c024963 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.299643:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c02471e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb1e expref: 12 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.299650:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782480810.299653:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782480810.299657:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097bc3f61/0x3dc3ebf33c024963 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.299689:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c02471e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb1e expref: 12 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.299703:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c02471e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb1e expref: 12 pid: 6602 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480810.299717:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7557ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6605:1869066311646336:192.168.204.51@tcp:104: 00000100:00100000:1.0:1782480810.299810:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46016000 going to sleep for 11 seconds 00000100:00100000:1.0:1782480810.300123:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480810.300564:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291738880 00000100:00100000:1.0:1782480810.300570:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291738880 00000100:00100000:1.0:1782480810.300603:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:1.0:1782480810.300610:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+13:2367:x1869066291738880:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1782480810.304189:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480810.304216:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006dfae7c3/0x3dc3ebf33c02495c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.304230:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572c00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:3.0:1782480810.304235:0:7486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006dfae7c3/0x3dc3ebf33c02495c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.304247:0:7486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006dfae7c3/0x3dc3ebf33c02495c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.304269:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006dfae7c3/0x3dc3ebf33c02495c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.304277:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006dfae7c3/0x3dc3ebf33c02495c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.304437:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480810.304439:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480810.304441:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480810.307163:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7557ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6605:1869066311646336:192.168.204.51@tcp:104: 00010000:00010000:3.0:1782480810.307192:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000097bc3f61/0x3dc3ebf33c024963 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480810.307391:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480810.307594:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291739008 00000100:00100000:2.0:1782480810.307602:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291739008 00010000:00010000:2.0:1782480810.307636:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c02471e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb1e expref: 14 pid: 6602 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480810.307669:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:2.0:1782480810.307678:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+14:2367:x1869066291739008:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480810.307693:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480810.307700:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c02471e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb1e expref: 14 pid: 6602 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.307728:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c02471e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb1e expref: 14 pid: 6602 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.307775:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c02471e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb1e expref: 14 pid: 6602 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.307791:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782480810.307795:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782480810.307801:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000097bc3f61/0x3dc3ebf33c024963 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.307811:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097bc3f61/0x3dc3ebf33c024963 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.307834:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480810.307881:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+13:2367:x1869066291739008:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 203us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480810.307889:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 84 00010000:00010000:2.0:1782480810.309471:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000097bc3f61/0x3dc3ebf33c024963 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.309489:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097bc3f61/0x3dc3ebf33c024963 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.309501:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097bc3f61/0x3dc3ebf33c024963 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.309520:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097bc3f61/0x3dc3ebf33c024963 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.309538:0:6605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782480810.310019:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3318:x1869066311646080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10419us (14960us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1782480810.310030:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:2.0:1782480810.310063:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480810.310069:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097bc3f61/0x3dc3ebf33c024963 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.310078:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573800 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480810.310083:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097bc3f61/0x3dc3ebf33c024963 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.310092:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097bc3f61/0x3dc3ebf33c024963 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.310111:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097bc3f61/0x3dc3ebf33c024963 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.310119:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097bc3f61/0x3dc3ebf33c024963 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.310138:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480810.310147:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480810.310150:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782480810.310525:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d757c4380/2, rc 0, transno 4294967321 00000100:00100000:0.0:1782480810.310533:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d757c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311646208:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1782480810.310586:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d7b2bea00/2, rc 0, transno 4294967322 00000100:00100000:0.0:1782480810.310589:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b2bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311646080:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1782480810.342506:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1782480810.342521:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:3.0:1782480810.342533:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:1.0:1782480810.342724:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75578000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2367:x1869066291738880:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 Request processed in 42108us (42597us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480810.342735:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:1.0:1782480810.345572:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480810.345675:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291739264 00000100:00100000:2.0:1782480810.345686:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291739264 00000100:00100000:2.0:1782480810.345774:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 228 00000100:00100000:2.0:1782480810.345785:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+20:11611:x1869066291739264:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782480810.345836:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480810.345860:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573200/0x3dc3ebf33c024947 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbb1 expref: 20 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.345879:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:2.0:1782480810.345883:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782480810.345913:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c02496a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.345926:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c02496a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.345948:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c02496a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480810.346347:0:5809:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000005f840ad reply state 00000000427eb0dc transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c02496a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480810.346357:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782480810.346710:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+21:11611:x1869066291739264:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 925us (1146us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1782480810.346719:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 228 00010000:00010000:2.0:1782480810.357023:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c02496a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.357065:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c02496a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.357073:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c02496a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.357079:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480810.357084:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c02496a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.357102:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c02496a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.357120:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:2.0:1782480810.357123:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480810.357127:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c02496a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.357133:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c02496a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480810.357639:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480810.357718:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291739392 00000100:00100000:0.0:1782480810.357728:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291739392 00000100:00100000:0.0:1782480810.357805:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:0.0:1782480810.357817:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2366:x1869066291739392:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782480810.358036:0:8678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1782480810.358040:0:8678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1782480810 -> 1782480809 00002000:00010000:0.0:1782480810.358042:0:8678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1782480809 00002000:00010000:0.0:1782480810.358045:0:8678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1782480810 -> 1782480809 00002000:00010000:0.0:1782480810.358047:0:8678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1782480810.358119:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2366:x1869066291739392:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 305us (484us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1782480810.358127:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:3.0:1782480810.364805:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480810.364919:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291739648 00000100:00100000:0.0:1782480810.364932:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291739648 00000100:00100000:0.0:1782480810.365001:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 229 00000100:00100000:0.0:1782480810.365011:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+20:11611:x1869066291739648:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1782480810.365081:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024971 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.365107:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02492b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fba3 expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.365116:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024971 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.365148:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02492b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fba3 expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.365161:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02492b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fba3 expref: 20 pid: 5807 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480810.365194:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75a38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1869066311646464:192.168.204.51@tcp:104: 00000100:00100000:0.0:1782480810.365285:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75626f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782480810.368045:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75a38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1869066311646464:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480810.368078:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024971 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480810.368466:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480810.368850:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291739776 00000100:00100000:1.0:1782480810.368858:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291739776 00010000:00010000:1.0:1782480810.368901:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02492b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fba3 expref: 21 pid: 5807 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480810.368934:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:1.0:1782480810.368951:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+21:2367:x1869066291739776:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480810.368966:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480810.368972:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02492b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fba3 expref: 21 pid: 5807 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.368984:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02492b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fba3 expref: 21 pid: 5807 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.369007:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573e00/0x3dc3ebf33c02492b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fba3 expref: 21 pid: 5807 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.369024:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:1.0:1782480810.369043:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024971 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.369054:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024971 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.369061:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024971 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.369332:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480810.369391:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+20:2367:x1869066291739776:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 439us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480810.369400:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 85 00010000:00010000:2.0:1782480810.374351:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024971 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.374369:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024971 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.376394:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024971 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.376412:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024971 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.376419:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024971 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.376425:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2ca00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480810.376430:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024971 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.376438:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024971 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.376477:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:3.0:1782480810.376480:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1782480810.376486:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024971 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.376491:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ca00/0x3dc3ebf33c024971 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480810.376629:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+19:11611:x1869066291739648:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 Request processed in 11613us (11829us total) trans 0 rc -22/-22 00000100:00100000:3.0:1782480810.376640:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 229 00000100:00100000:3.0:1782480810.380130:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480810.380194:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291739904 00000100:00100000:0.0:1782480810.380212:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291739904 00000100:00100000:0.0:1782480810.380271:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:0.0:1782480810.380281:0:6605:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2369:x1869066291739904:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1782480810.380323:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024978 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.380344:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088c997a4/0x3dc3ebf33c024955 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbbf expref: 8 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.380352:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480810.380356:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782480810.380361:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024978 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.380404:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088c997a4/0x3dc3ebf33c024955 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbbf expref: 8 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.380418:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088c997a4/0x3dc3ebf33c024955 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbbf expref: 8 pid: 8678 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480810.380448:0:6605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75a38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6605:1869066311646592:192.168.204.51@tcp:104: 00000100:00100000:0.0:1782480810.380766:0:6605:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75626f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480810.383907:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480810.384020:0:6605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75a38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6605:1869066311646592:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480810.384047:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024978 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480810.384492:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291740032 00000100:00100000:2.0:1782480810.384499:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291740032 00010000:00010000:2.0:1782480810.384542:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000088c997a4/0x3dc3ebf33c024955 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbbf expref: 9 pid: 8678 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480810.384604:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:2.0:1782480810.384614:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+9:2367:x1869066291740032:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480810.384630:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480810.384652:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000088c997a4/0x3dc3ebf33c024955 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbbf expref: 9 pid: 8678 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.384665:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000088c997a4/0x3dc3ebf33c024955 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbbf expref: 9 pid: 8678 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.384688:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088c997a4/0x3dc3ebf33c024955 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbbf expref: 9 pid: 8678 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.384706:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782480810.384709:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782480810.384715:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024978 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.384724:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024978 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.384778:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480810.384833:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2367:x1869066291740032:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 220us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480810.384841:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 86 00010000:00010000:3.0:1782480810.386338:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024978 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.386354:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024978 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.386398:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024978 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.386407:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024978 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.386417:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024978 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.386443:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2da00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:3.0:1782480810.386447:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024978 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.386457:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024978 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.386473:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024978 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.386481:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024978 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480810.386559:0:6605:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2369:x1869066291739904:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 Request processed in 6277us (6436us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480810.386568:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:3.0:1782480810.389862:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480810.389978:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291740288 00000100:00100000:2.0:1782480810.389989:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291740288 00000100:00100000:2.0:1782480810.390055:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 230 00000100:00100000:2.0:1782480810.390074:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+19:11611:x1869066291740288:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782480810.390183:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c02497f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.390215:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c02497f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.390231:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c02497f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.390664:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024986 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.390675:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024939 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbaa expref: 20 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.390682:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024986 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.390719:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024939 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbaa expref: 20 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.390999:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024939 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbaa expref: 20 pid: 5809 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480810.391016:0:5808:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1869066311646720:192.168.204.51@tcp:104: 00000100:00100000:2.0:1782480810.391306:0:5808:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45265300 going to sleep for 11 seconds 00000100:00100000:2.0:1782480810.395296:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480810.395500:0:5808:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1869066311646720:192.168.204.51@tcp:104: 00010000:00010000:3.0:1782480810.395529:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024986 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480810.395792:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291740416 00000100:00100000:1.0:1782480810.395800:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291740416 00010000:00010000:1.0:1782480810.395841:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024939 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbaa expref: 21 pid: 5809 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480810.395883:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:1.0:1782480810.395893:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d684d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+21:2367:x1869066291740416:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480810.395909:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480810.395917:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024939 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbaa expref: 21 pid: 5809 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.395929:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024939 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbaa expref: 21 pid: 5809 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.395971:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024939 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbaa expref: 21 pid: 5809 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.396005:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:1.0:1782480810.396011:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024986 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.396020:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024986 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.396028:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024986 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480810.396060:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480810.396138:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d684d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+20:2367:x1869066291740416:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 246us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480810.396147:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 87 00010000:00010000:3.0:1782480810.396878:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024986 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.396888:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024986 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782480810.397101:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1782480810.397257:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1782480810.397300:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1782480810.397523:0:5808:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fe72300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5808:1869066311646848:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782480810.397579:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480810.397612:0:5808:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49fbdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782480810.398616:0:5812:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311646848 00000100:00100000:2.0:1782480810.398626:0:5812:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311646848 00000100:00100000:2.0:1782480810.398679:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782480810.398688:0:5812:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5808:x1869066311646848:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782480810.398805:0:5812:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5808:x1869066311646848:12345-0@lo:1000:mdt00_001.0 Request processed in 118us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480810.398812:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782480810.398912:0:5808:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1782480810.398919:0:5808:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1782480810.398950:0:5808:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d757c4380, transno 4294967321 00000100:00100000:3.0:1782480810.398974:0:5808:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9b6d7b2bea00 x1869066311646080/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782480826 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480810.398987:0:5808:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fe72300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5808:1869066311646848:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1782480810.400052:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1782480810.400148:0:5808:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fe72300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5808:1869066311646976:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782480810.400209:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480810.400241:0:5808:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46a5b900 going to sleep for 11 seconds 00000100:00100000:1.0:1782480810.400776:0:5812:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311646976 00000100:00100000:1.0:1782480810.400785:0:5812:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311646976 00000100:00100000:1.0:1782480810.400845:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782480810.400857:0:5812:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5808:x1869066311646976:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1782480810.401083:0:5812:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5808:x1869066311646976:12345-0@lo:1000:mdt00_001.0 Request processed in 229us (883us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1782480810.401103:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782480810.401361:0:5808:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fe72300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5808:1869066311646976:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1782480810.401409:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024986 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.401419:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024986 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.401427:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024986 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.401432:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480810.401442:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024986 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.401450:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024986 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.401466:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:2.0:1782480810.401476:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782480810.401481:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024986 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.401486:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024986 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.401539:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0248c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.401546:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0248c9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.401551:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0248c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.401555:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c600 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480810.401557:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0248c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.401563:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0248c9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.401571:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:2.0:1782480810.401573:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782480810.401586:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c0248d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb8e expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.401597:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c0248d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb8e expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.401613:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c0248d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb8e expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.401651:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c0248d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb8e expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480810.401684:0:5808:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1869066311647104:192.168.204.51@tcp:105: 00000100:00100000:2.0:1782480810.401803:0:5808:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45265600 going to sleep for 11 seconds 00000100:00100000:2.0:1782480810.405989:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480810.406049:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291740544 00000100:00100000:1.0:1782480810.406058:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291740544 00000100:00100000:1.0:1782480810.406123:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:1.0:1782480810.406133:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+24:11610:x1869066291740544:12345-192.168.204.51@tcp:49:lfs.0 00000100:00100000:1.0:1782480810.406457:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+24:11610:x1869066291740544:12345-192.168.204.51@tcp:49:lfs.0 Request processed in 324us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480810.406492:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:3.0:1782480810.408897:0:5808:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5808:1869066311647104:192.168.204.51@tcp:105: 00010000:00010000:3.0:1782480810.408928:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0248c9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.408951:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c0248c9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.409100:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02498d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.409124:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02498d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.409136:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02498d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.409154:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02498d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.409162:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02498d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.409168:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02498d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.409175:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480810.409178:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02498d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.409192:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02498d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.409219:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:2.0:1782480810.409222:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480810.409244:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02498d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.409257:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9200/0x3dc3ebf33c02498d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.409269:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c02497f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.409275:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c02497f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.409280:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c02497f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.409292:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480810.409295:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c02497f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.409301:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c02497f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.409308:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:2.0:1782480810.409311:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782480810.409314:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c02497f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.409320:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c02497f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480810.409568:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+23:11611:x1869066291740288:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 19502us (19729us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1782480810.409586:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 230 00000020:00080000:2.0:1782480810.409599:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1782480810.411162:0:11541:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480810.411173:0:11541:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480810.411697:0:11541:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1782480810.411709:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782480810.413414:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480810.413630:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291740800 00000100:00100000:1.0:1782480810.413641:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291740800 00000100:00100000:1.0:1782480810.413698:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 231 00000100:00100000:1.0:1782480810.413708:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+23:11610:x1869066291740800:12345-192.168.204.51@tcp:58:lfs.0 00000040:00080000:1.0:1782480810.414082:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1782480810.414180:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+23:11610:x1869066291740800:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 471us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480810.414188:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 231 00000100:00100000:1.0:1782480810.420844:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480810.420970:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291741056 00000100:00100000:2.0:1782480810.420980:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291741056 00000100:00100000:2.0:1782480810.421037:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:2.0:1782480810.421046:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45d55850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+23:11611:x1869066291741056:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1782480810.421720:0:5811:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1782480810.421842:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1782480810.421886:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024994 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.421902:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024994 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.421914:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024994 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.421923:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024994 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.421928:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024994 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.421947:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024994 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.421971:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782480810.422058:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45d55850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+25:11611:x1869066291741056:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 1011us (1222us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1782480810.422066:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 62 00000020:00080000:2.0:1782480810.422071:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782480810.422349:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480810.422357:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024994 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.422374:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8400 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:3.0:1782480810.422378:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024994 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.422385:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024994 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.422398:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b6d45d62e00) 00010000:00010000:3.0:1782480810.422401:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782480810.422405:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024994 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.422412:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8400/0x3dc3ebf33c024994 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.422427:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480810.422488:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480810.422491:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480810.451738:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480810.451989:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291741184 00000100:00100000:3.0:1782480810.452007:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291741184 00000100:00100000:3.0:1782480810.452069:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 232 00000100:00100000:3.0:1782480810.452081:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+25:11613:x1869066291741184:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1782480810.452379:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480810.452398:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c02499b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fbc6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.452460:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c0249a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.452492:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c0249a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.452504:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c0249a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.452521:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0249a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.452528:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0249a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.452534:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0249a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.453341:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c0249b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.453356:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0248bb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb87 expref: 26 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.453365:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c0249b0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.453401:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0248bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb87 expref: 26 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480810.453416:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0248bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb87 expref: 26 pid: 11544 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480810.453442:0:5807:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1869066311647232:192.168.204.51@tcp:104: 00000100:00100000:3.0:1782480810.453602:0:5807:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46a5bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480810.459780:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480810.459869:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291741440 00000100:00100000:2.0:1782480810.459877:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291741440 00000100:00100000:2.0:1782480810.459948:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:2.0:1782480810.459958:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+27:5580:x1869066291741440:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1782480810.460215:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+28:5580:x1869066291741440:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 257us (484us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1782480810.460223:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:3.0:1782480810.463514:0:5807:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5807:1869066311647232:192.168.204.51@tcp:104: 00010000:00010000:3.0:1782480810.463548:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c0249b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480810.464517:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480810.464623:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291741568 00000100:00100000:0.0:1782480810.464632:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291741568 00010000:00010000:0.0:1782480810.464674:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0248bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb87 expref: 28 pid: 11544 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480810.464713:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:0.0:1782480810.464722:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+28:2366:x1869066291741568:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480810.464972:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480810.464981:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0248bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb87 expref: 28 pid: 11544 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.465071:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0248bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb87 expref: 28 pid: 11544 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.465182:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821eda00/0x3dc3ebf33c0248bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb87 expref: 28 pid: 11544 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.465196:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:0.0:1782480810.465320:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c0249b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.465330:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c0249b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.465336:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c0249b0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480810.465367:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782480810.465485:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c0249b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.465494:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c0249b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480810.465538:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1782480810.465542:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480810.465563:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c0249b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.465574:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c0249b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.465584:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c0249a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.465591:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c0249a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.465598:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c0249a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.465604:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ec000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480810.465609:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c0249a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.465623:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c0249a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.465634:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:2.0:1782480810.465636:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480810.465639:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c0249a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.465644:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec000/0x3dc3ebf33c0249a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.465654:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0249a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.465660:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0249a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.465666:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0249a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.465671:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d821ec800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480810.465674:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0249a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.465679:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0249a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.465687:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b6d4bddc000) 00010000:00010000:2.0:1782480810.465690:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480810.465693:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0249a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.465707:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec800/0x3dc3ebf33c0249a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.465796:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ecc00/0x3dc3ebf33c02499b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbc6 expref: 28 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.465810:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c0249b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbc6 expref: 27 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480810.465817:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:2.0:1782480810.465820:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782480810.465822:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d82165200, rc 0) 00000100:00100000:0.0:1782480810.466001:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+27:2366:x1869066291741568:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 1270us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480810.466011:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:2.0:1782480810.466792:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+26:11613:x1869066291741184:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 14709us (15058us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480810.466801:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 232 00010000:00010000:3.0:1782480810.678895:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782480811.416643:0:12423:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782480811.416653:0:12423:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782480811.416700:0:12423:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1782480811.416705:0:12423:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1782480811.449936:0:11541:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480811.449946:0:11541:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480811.449988:0:11541:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1782480811.449995:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782480811.450124:0:11541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75a38380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11541:1869066311647360:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782480811.450225:0:11541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d4c5836c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480811.459276:0:11541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75a38380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11541:1869066311647360:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782480811.463635:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480811.466023:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291741696 00000100:00100000:2.0:1782480811.466038:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291741696 00000100:00100000:2.0:1782480811.466129:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 233 00000100:00100000:2.0:1782480811.466145:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+26:11624:x1869066291741696:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782480811.466185:0:5808:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00080000:0.0:1782480811.466301:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480811.466314:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+26:11624:x1869066291741696:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 173us (2696us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480811.466323:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 233 00000100:00100000:1.0:1782480811.470409:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480811.470478:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291741952 00000100:00100000:3.0:1782480811.470488:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291741952 00000100:00100000:3.0:1782480811.470552:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 234 00000100:00100000:3.0:1782480811.470562:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+26:11624:x1869066291741952:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480811.470582:0:10450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480811.470602:0:10450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c0249b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fbcd expref: -99 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480811.470742:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c0249be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480811.470792:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c0249be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480811.470806:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c0249be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480811.470818:0:10450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1782480811.470969:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164000/0x3dc3ebf33c0249b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbcd expref: 29 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480811.470991:0:10450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c0249be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbcd expref: 28 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480811.471000:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:3.0:1782480811.471003:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480811.471006:0:10450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d82164e00, rc 0) 00000100:00100000:3.0:1782480811.471063:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+28:11624:x1869066291741952:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 502us (663us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1782480811.471071:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 234 00000100:00100000:0.0:1782480811.481950:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480811.482390:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480811.483044:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291742080 00000100:00100000:1.0:1782480811.483054:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291742080 00000100:00100000:1.0:1782480811.483114:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:1.0:1782480811.483125:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75a39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+28:2367:x1869066291742080:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480811.483141:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480811.483165:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82164e00/0x3dc3ebf33c0249be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbcd expref: 28 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480811.483184:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:1.0:1782480811.483188:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480811.483253:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75a39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+27:2367:x1869066291742080:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 130us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480811.483262:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:2.0:1782480811.483401:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291742336 00000100:00100000:2.0:1782480811.483406:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291742336 00000100:00100000:2.0:1782480811.483454:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 235 00000100:00100000:2.0:1782480811.483469:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+27:11624:x1869066291742336:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782480811.483539:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0249cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480811.483554:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0249cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480811.483564:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0249cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480811.483783:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0249cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480811.483791:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0249cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480811.483799:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0249cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480811.483804:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480811.483808:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0249cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480811.483816:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0249cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480811.483825:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:2.0:1782480811.483827:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782480811.483830:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0249cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480811.483836:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c0249cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480811.483978:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+28:11624:x1869066291742336:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 509us (1588us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1782480811.483987:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 235 00000040:00080000:3.0:1782480811.484035:0:11541:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782480811.484042:0:11541:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782480811.488440:0:11541:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1782480811.489831:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782480811.490889:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480811.491277:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291742592 00000100:00100000:2.0:1782480811.491368:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291742592 00000100:00100000:2.0:1782480811.491443:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:2.0:1782480811.491454:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+28:11624:x1869066291742592:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782480811.491732:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+29:11624:x1869066291742592:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 279us (849us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1782480811.491743:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 64 00010000:00010000:2.0:1782480811.721115:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480811.767180:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fe70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311647744:0@lo:400:kworker.0 00000100:00100000:0.0:1782480811.767180:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311647488:0@lo:400:kworker.0 00000100:00100000:3.0:1782480811.767250:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311647616:0@lo:400:kworker.0 00000100:00100000:0.0:1782480811.767539:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480811.767599:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d757c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311648000:0@lo:400:kworker.0 00000100:00100000:0.0:1782480811.767625:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480811.767661:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311647872:0@lo:400:kworker.0 00000100:00100000:0.0:1782480811.767686:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480811.767715:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311648000 00000100:00100000:0.0:1782480811.767721:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311648000 00000100:00100000:0.0:1782480811.767799:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1782480811.767808:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311648000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480811.767858:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311648000:12345-0@lo:400:kworker.0 Request processed in 51us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480811.767865:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1782480811.767886:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311647872 00000100:00100000:0.0:1782480811.767889:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311647872 00000100:00100000:0.0:1782480811.767928:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1782480811.767935:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3318:x1869066311647872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480811.768291:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311647488 00000100:00100000:2.0:1782480811.768296:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311647488 00000100:00100000:2.0:1782480811.768329:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1782480811.768335:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311647488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480811.768372:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311647488:12345-0@lo:400:kworker.0 Request processed in 37us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480811.768378:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1782480811.770079:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3318:x1869066311647872:12345-0@lo:400:kworker.0 Request processed in 2137us (2384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480811.770093:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1782480811.770133:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480811.770172:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311647488:0@lo:400:kworker.0 00000100:00100000:0.0:1782480811.770191:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d757c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311648000:0@lo:400:kworker.0 00000100:00100000:2.0:1782480811.770417:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311647872:0@lo:400:kworker.0 00000100:00100000:1.0:1782480811.773022:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480811.773092:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311647744 00000100:00100000:1.0:1782480811.773099:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311647744 00000100:00100000:1.0:1782480811.773171:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1782480811.773180:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311647744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480811.774518:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311647744:12345-0@lo:400:kworker.0 Request processed in 1332us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480811.774531:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:1.0:1782480811.774569:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480811.774601:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fe70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311647744:0@lo:400:kworker.0 00000100:00100000:3.0:1782480811.779847:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480811.779906:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4737ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311648128:0@lo:400:kworker.0 00000100:00100000:3.0:1782480811.779964:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480811.780157:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311647616 00000100:00100000:0.0:1782480811.780165:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311647616 00000100:00100000:0.0:1782480811.780220:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1782480811.780228:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311647616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480811.780306:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311647616:12345-0@lo:400:kworker.0 Request processed in 78us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480811.780313:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1782480811.780356:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311647616:0@lo:400:kworker.0 00000100:00100000:1.0:1782480811.780666:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311648128 00000100:00100000:1.0:1782480811.780672:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311648128 00000100:00100000:1.0:1782480811.780715:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1782480811.780723:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3316:x1869066311648128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480811.780789:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3316:x1869066311648128:12345-0@lo:400:kworker.0 Request processed in 67us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480811.780796:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1782480811.780801:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4737ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311648128:0@lo:400:kworker.0 00000100:00100000:2.0:1782480812.280944:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782480812.280971:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4737a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311648256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480812.281052:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480812.281126:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311648256 00000100:00100000:2.0:1782480812.281135:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311648256 00000100:00100000:2.0:1782480812.282363:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1782480812.282392:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4737ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1869066311648256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782480812.282435:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480812.282503:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4737ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1869066311648256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480812.282510:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1782480812.282561:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4737a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311648256:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782480812.285423:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782480812.735589:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782480813.511079:0:12475:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782480813.511088:0:12475:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782480813.511131:0:12475:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1782480813.511138:0:12475:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782480813.746061:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480813.749361:0:11544:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291742848 00000100:00100000:0.0:1782480813.749376:0:11544:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291742848 00000100:00080000:1.0:1782480813.749608:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480813.749638:0:11544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 236 00000100:00100000:0.0:1782480813.749654:0:11544:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7591ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+29:11646:x1869066291742848:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1782480813.749678:0:11544:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480813.749696:0:11544:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c0249d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fbd4 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480813.749820:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c0249da lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480813.749835:0:11544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c0249da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480813.749847:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c0249da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480813.749860:0:11544:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1782480813.750000:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c0249d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbd4 expref: 32 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480813.750016:0:11544:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c0249da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbd4 expref: 31 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480813.750040:0:11544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:0.0:1782480813.750044:0:11544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782480813.750047:0:11544:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2c800, rc 0) 00000100:00100000:0.0:1782480813.750120:0:11544:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7591ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49099535-dcd3-436f-aa96-9770a3f52e5b+31:11646:x1869066291742848:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 469us (4069us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1782480813.750127:0:11544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 236 00000100:00100000:1.0:1782480813.753890:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480813.754177:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291742976 00000100:00100000:0.0:1782480813.754202:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291742976 00000100:00100000:0.0:1782480813.754261:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 237 00000100:00100000:0.0:1782480813.754270:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+31:11646:x1869066291742976:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:0.0:1782480813.754351:0:10450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c0249e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480813.754370:0:10450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c0249e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480813.754380:0:10450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c0249e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480813.754407:0:10450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c0249e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480813.754423:0:10450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c0249e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480813.754430:0:10450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c0249e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480813.754436:0:10450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480813.754454:0:10450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c0249e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480813.754463:0:10450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c0249e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480813.754475:0:10450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:0.0:1782480813.754478:0:10450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782480813.754483:0:10450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c0249e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480813.754489:0:10450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c0249e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10450 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480813.754563:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+31:11646:x1869066291742976:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 293us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480813.754571:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 237 00010000:00010000:0.0:1782480813.756559:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480813.815377:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480813.815403:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4737a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311648384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480813.815484:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480813.815610:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311648384 00000100:00100000:2.0:1782480813.815618:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311648384 00000100:00100000:2.0:1782480813.815690:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782480813.815701:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869066311648384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782480813.815737:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480813.815801:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869066311648384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480813.815808:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782480813.815855:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4737a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311648384:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782480813.815926:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1782480813.908424:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1782480813.908971:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480813.909017:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291743104 00000100:00100000:2.0:1782480813.909026:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291743104 00000100:00100000:2.0:1782480813.909087:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:2.0:1782480813.909112:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4737a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2369:x1869066291743104:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:2.0:1782480813.909132:0:8678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480813.909164:0:8678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b853278/0x3dc3ebf33c0249ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fbdb expref: -99 pid: 8678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782480813.909193:0:8678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a3e7fa9, atime: 0x6a3e7fa9, ctime: 0x6a3e7fa9, blocks: 0xb 00010000:00010000:2.0:1782480813.909234:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1782480813.909239:0:8678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480813.909249:0:8678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b853278/0x3dc3ebf33c0249ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbdb expref: 8 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480813.909264:0:8678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b853278/0x3dc3ebf33c0249ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbdb expref: 8 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480813.909278:0:8678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e8a00, rc 0) 00000100:00100000:2.0:1782480813.909331:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4737a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2369:x1869066291743104:12345-192.168.204.51@tcp:101:cat.0 Request processed in 222us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480813.909339:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00080000:2.0:1782480813.909361:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1782480813.909955:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1782480813.912132:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1782480813.918018:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480813.918190:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291743232 00000100:00100000:3.0:1782480813.918202:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291743232 00002000:00100000:3.0:1782480813.918254:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9b6d7ac1df80 x1869066291743232/t0(0) o3->49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp:569/0 lens 488/0 e 0 to 0 dl 1782480824 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782480813.918264:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d7ac1df80 with x1869066291743232 ext(0->4095) 00002000:00010000:3.0:1782480813.918285:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d7ac1df80 00000100:00100000:3.0:1782480813.918320:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:3.0:1782480813.918330:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2367:x1869066291743232:12345-192.168.204.51@tcp:3:cat.0 00000100:00100000:3.0:1782480813.918591:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+8:2367:x1869066291743232:12345-192.168.204.51@tcp:3:cat.0 Request processed in 261us (586us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1782480813.918610:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00002000:00100000:3.0:1782480813.918617:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9b6d7ac1df80 x1869066291743232/t0(0) o3->49099535-dcd3-436f-aa96-9770a3f52e5b@192.168.204.51@tcp:569/0 lens 488/4536 e 0 to 0 dl 1782480824 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782480813.918627:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b6d7ac1df80 with x1869066291743232 ext(0->4095) 00002000:00010000:3.0:1782480813.918631:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b6d7ac1df80 00000100:00100000:1.0:1782480814.178341:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480814.178381:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480814.178422:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480814.178677:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291743616 00000100:00100000:0.0:1782480814.178686:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291743616 00000100:00100000:0.0:1782480814.178782:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 163 00000100:00100000:0.0:1782480814.178792:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ac1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2368:x1869066291743616:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480814.178880:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ac1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2368:x1869066291743616:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 89us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480814.178889:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 163 00000100:00100000:3.0:1782480814.179069:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291743360 00000100:00100000:3.0:1782480814.179074:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291743360 00000100:00100000:3.0:1782480814.179114:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 300 00000100:00100000:3.0:1782480814.179121:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2368:x1869066291743360:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480814.179159:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2368:x1869066291743360:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 39us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480814.179166:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 300 00000100:00080000:1.0:1782480814.179663:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480814.180187:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291743488 00000100:00100000:2.0:1782480814.180196:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291743488 00000100:00100000:2.0:1782480814.180267:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00100000:2.0:1782480814.180278:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2368:x1869066291743488:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480814.180324:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2368:x1869066291743488:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 50us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480814.180329:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00080000:0.0:1782480814.182653:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782480814.775544:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782480815.403437:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1782480815.403459:0:5829:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1782480815.403508:0:5829:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b6d46a5bf00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1782480815.403514:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9b6d7ae0b800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d46a5bc00 00000020:00080000:1.0:1782480815.403517:0:5829:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9b6d7ae0bb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b6d7b31d000 00000020:00080000:0.0:1782480815.403584:0:5841:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1782480815.403799:0:5841:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1782480815.421407:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1782480815.421422:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:3.0:1782480815.800928:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480816.829868:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480816.889465:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782480816.889488:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311648512:0@lo:400:kworker.0 00000100:00100000:3.0:1782480816.889556:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480816.889615:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311648512 00000100:00100000:3.0:1782480816.889622:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311648512 00000100:00100000:3.0:1782480816.889670:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1782480816.889694:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3316:x1869066311648512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480816.889770:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3316:x1869066311648512:12345-0@lo:400:kworker.0 Request processed in 77us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480816.889778:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1782480816.889848:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311648512:0@lo:400:kworker.0 00000100:00100000:3.0:1782480816.889887:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311648640:0@lo:400:kworker.0 00000100:00100000:3.0:1782480816.889914:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480816.889961:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782480816.889969:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1869066311648768:0@lo:400:kworker.0 00000100:00100000:3.0:1782480816.889995:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480816.890034:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311648896:0@lo:400:kworker.0 00000100:00100000:3.0:1782480816.890063:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480816.890100:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782480816.890105:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066311649024:0@lo:400:kworker.0 00000100:00100000:3.0:1782480816.890130:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480816.890168:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311649152:0@lo:400:kworker.0 00000100:00100000:3.0:1782480816.890197:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480816.890327:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311648640 00000100:00100000:1.0:1782480816.890332:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311648640 00000100:00100000:1.0:1782480816.890362:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311648768 00000100:00100000:1.0:1782480816.890364:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311648768 00000100:00100000:1.0:1782480816.890384:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311649024 00000100:00100000:1.0:1782480816.890386:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311649024 00000100:00100000:1.0:1782480816.890398:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1782480816.890403:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311648640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480816.890440:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311648640:12345-0@lo:400:kworker.0 Request processed in 37us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480816.890446:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1782480816.890457:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1782480816.890461:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869066311648768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480816.890496:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1782480816.890503:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7ae94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066311649024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480816.890529:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7ae94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066311649024:12345-0@lo:400:kworker.0 Request processed in 27us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480816.890535:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1782480816.890608:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869066311648768:12345-0@lo:400:kworker.0 Request processed in 146us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480816.890615:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:1.0:1782480816.890632:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480816.890657:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066311649024:0@lo:400:kworker.0 00000100:00100000:1.0:1782480816.890668:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311648640:0@lo:400:kworker.0 00000100:00100000:3.0:1782480816.890977:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1869066311648768:0@lo:400:kworker.0 00000100:00100000:2.0:1782480816.891203:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311648896 00000100:00100000:2.0:1782480816.891209:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311648896 00000100:00100000:2.0:1782480816.891291:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311649152 00000100:00100000:2.0:1782480816.891295:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311649152 00000100:00100000:3.0:1782480816.891332:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782480816.891347:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311648896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480816.891391:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311648896:12345-0@lo:400:kworker.0 Request processed in 46us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480816.891397:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782480816.891421:0:3318:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1782480816.891426:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1782480816.891439:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d7fe73b80, transno 4294967310 00000100:00100000:3.0:1782480816.891454:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311648896:0@lo:400:kworker.0 00000100:00080000:1.0:1782480816.893057:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782480816.893064:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480816.893218:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782480816.893233:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311649152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480816.893332:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311649152:12345-0@lo:400:kworker.0 Request processed in 104us (3133us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480816.893340:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1782480816.893405:0:3316:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1782480816.893412:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d7b2bea00, transno 4294967322 00000004:00080000:1.0:1782480816.893431:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1782480816.893449:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311649152:0@lo:400:kworker.0 00000100:00100000:0.0:1782480817.403503:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311649280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480817.403587:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480817.404492:0:6606:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311649280 00000100:00100000:0.0:1782480817.404502:0:6606:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311649280 00000100:00100000:0.0:1782480817.404554:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782480817.409444:0:6606:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311649280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782480817.409488:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480817.409592:0:6606:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311649280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (6004us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480817.409759:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311649280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480817.413313:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1782480817.849495:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480818.877354:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480818.936688:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311649408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480818.936802:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480818.936914:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311649408 00000100:00100000:3.0:1782480818.936923:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311649408 00000100:00100000:3.0:1782480818.936995:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1782480818.937005:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311649408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480818.937052:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480818.937107:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311649408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480818.937115:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1782480818.938076:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480818.938315:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311649408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480819.287883:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480819.287942:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480819.287967:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480819.287993:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480819.288020:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480819.288204:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291743744 00000100:00100000:1.0:1782480819.288216:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291743744 00000100:00100000:1.0:1782480819.288268:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 302 00000100:00100000:1.0:1782480819.288278:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2369:x1869066291743744:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480819.288416:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291744000 00000100:00100000:3.0:1782480819.288421:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291744000 00000100:00100000:3.0:1782480819.289350:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291744128 00000100:00100000:3.0:1782480819.289358:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291744128 00000100:00100000:3.0:1782480819.289395:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 99 00000100:00100000:3.0:1782480819.289407:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2369:x1869066291744000:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480819.294148:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2369:x1869066291743744:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 5854us (6260us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480819.294163:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 302 00000100:00100000:0.0:1782480819.294796:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291744256 00000100:00100000:0.0:1782480819.294806:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291744256 00000100:00100000:0.0:1782480819.294860:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291743872 00000100:00100000:0.0:1782480819.294864:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291743872 00000100:00100000:0.0:1782480819.294892:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 167 00000100:00100000:0.0:1782480819.294902:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2369:x1869066291744256:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480819.294986:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2369:x1869066291744256:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 86us (7017us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480819.294994:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 167 00000100:00100000:0.0:1782480819.295035:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 168 00000100:00100000:0.0:1782480819.295043:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+18:2369:x1869066291743872:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480819.295075:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+18:2369:x1869066291743872:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 33us (7081us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480819.295081:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 168 00000100:00100000:0.0:1782480819.295108:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 100 00000100:00100000:0.0:1782480819.295117:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75a39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2369:x1869066291744128:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480819.295145:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75a39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2369:x1869066291744128:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 29us (7123us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480819.295150:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 100 00000100:00080000:2.0:1782480819.295361:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782480819.295367:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782480819.295370:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480819.297212:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2369:x1869066291744000:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 7794us (9254us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480819.297227:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 99 00000100:00100000:0.0:1782480819.477864:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480819.477973:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291744384 00000100:00100000:2.0:1782480819.477983:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291744384 00000100:00100000:2.0:1782480819.478054:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 238 00000100:00100000:2.0:1782480819.478065:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+18:11290:x1869066291744384:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1782480819.478164:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+18:11290:x1869066291744384:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 Request processed in 100us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480819.478173:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 238 00000100:00100000:1.0:1782480819.485951:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480819.487554:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291744640 00000100:00100000:2.0:1782480819.487570:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291744640 00000100:00100000:2.0:1782480819.487718:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:2.0:1782480819.487729:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+18:11290:x1869066291744640:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782480819.488272:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+19:11290:x1869066291744640:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 542us (2331us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1782480819.488281:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:1.0:1782480819.810854:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480819.811087:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291744768 00000100:00100000:0.0:1782480819.811097:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291744768 00000100:00100000:0.0:1782480819.811166:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 239 00000100:00100000:0.0:1782480819.811176:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:12098:x1869066291744768:12345-192.168.204.51@tcp:101:lsof.0 00010000:00010000:0.0:1782480819.811197:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480819.811217:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c0249f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fbe2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480819.811291:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c0249fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480819.811304:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c0249fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480819.811318:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c0249fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480819.811646:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782480819.811651:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480819.811733:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c0249fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480819.811876:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c000/0x3dc3ebf33c0249f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbe2 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480819.811899:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c0249fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbe2 expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480819.811976:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d43255700) 00010000:00010000:0.0:1782480819.811980:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782480819.811983:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2c200, rc 0) 00000100:00100000:0.0:1782480819.812052:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:210e3ff4-fa06-469c-afa9-3e2abcd77331+6:12098:x1869066291744768:12345-192.168.204.51@tcp:101:lsof.0 Request processed in 877us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480819.812060:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 239 00010000:00010000:1.0:1782480819.895056:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1782480820.597204:0:5829:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1782480820.597243:0:5841:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1782480820.597255:0:5841:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:3.0:1782480820.602156:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00010000:00010000:2.0:1782480820.919182:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782480821.753442:0:11541:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782480821.753454:0:11541:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782480821.753882:0:11541:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:3.0:1782480821.753890:0:11541:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1782480821.943025:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480822.010183:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311649664:0@lo:400:kworker.0 00000100:00100000:1.0:1782480822.010270:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480822.010336:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311650176:0@lo:400:kworker.0 00000100:00100000:1.0:1782480822.010402:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480822.010443:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782480822.010449:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311649536:0@lo:400:kworker.0 00000100:00100000:1.0:1782480822.010477:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480822.010500:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066311650048:0@lo:400:kworker.0 00000100:00100000:1.0:1782480822.010521:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480822.010552:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311649536 00000100:00100000:1.0:1782480822.010559:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311649536 00000100:00100000:1.0:1782480822.010603:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1782480822.010613:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3316:x1869066311649536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480822.010667:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3316:x1869066311649536:12345-0@lo:400:kworker.0 Request processed in 56us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480822.010674:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1782480822.010705:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311649664 00000100:00100000:1.0:1782480822.010719:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311649664 00000100:00100000:1.0:1782480822.010741:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311650048 00000100:00100000:1.0:1782480822.010744:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311650048 00000100:00100000:1.0:1782480822.010802:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1782480822.010808:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311649664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480822.010843:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311649664:12345-0@lo:400:kworker.0 Request processed in 35us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480822.010849:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1782480822.010861:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1782480822.010867:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066311650048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480822.010894:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066311650048:12345-0@lo:400:kworker.0 Request processed in 27us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480822.010909:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:1.0:1782480822.010929:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480822.010953:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311649536:0@lo:400:kworker.0 00000100:00100000:1.0:1782480822.010965:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066311650048:0@lo:400:kworker.0 00000100:00100000:1.0:1782480822.010973:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311649664:0@lo:400:kworker.0 00000100:00100000:3.0:1782480822.011483:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311649792:0@lo:400:kworker.0 00000100:00100000:3.0:1782480822.011519:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480822.011558:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782480822.011564:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311649920:0@lo:400:kworker.0 00000100:00100000:3.0:1782480822.011588:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480822.011703:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311649792 00000100:00100000:2.0:1782480822.011719:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311649792 00000100:00100000:2.0:1782480822.011798:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1782480822.011806:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311649792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480822.011847:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311649792:12345-0@lo:400:kworker.0 Request processed in 42us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480822.011853:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:3.0:1782480822.011922:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480822.011946:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311649792:0@lo:400:kworker.0 00000100:00100000:0.0:1782480822.012038:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311650176 00000100:00100000:0.0:1782480822.012042:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311650176 00000100:00100000:0.0:1782480822.012086:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311649920 00000100:00100000:0.0:1782480822.012090:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311649920 00000100:00100000:0.0:1782480822.012112:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782480822.012120:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311650176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480822.012164:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311650176:12345-0@lo:400:kworker.0 Request processed in 46us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480822.012183:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1782480822.012294:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782480822.012302:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311649920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480822.012340:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311649920:12345-0@lo:400:kworker.0 Request processed in 40us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480822.012346:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1782480822.012363:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782480822.012366:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782480822.012395:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311649920:0@lo:400:kworker.0 00000100:00100000:3.0:1782480822.012474:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311650176:0@lo:400:kworker.0 00000100:00100000:3.0:1782480822.521422:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fe72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311650304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480822.521494:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480822.521631:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311650304 00000100:00100000:2.0:1782480822.521640:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311650304 00000100:00100000:2.0:1782480822.521708:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782480822.521719:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311650304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782480822.521783:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480822.521835:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311650304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480822.521842:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1782480822.522086:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fe72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311650304:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782480822.968975:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782480823.403085:0:12680:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 09:33:42 (1782480822) 00010000:00010000:2.0:1782480823.996103:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480824.055847:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782480824.055873:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f1c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311650432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480824.055971:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480824.056039:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311650432 00000100:00100000:3.0:1782480824.056048:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311650432 00000100:00100000:3.0:1782480824.056105:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782480824.056114:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311650432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480824.056150:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480824.056194:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311650432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480824.056201:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1782480824.056235:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480824.056268:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f1c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311650432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480824.409425:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480824.409514:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480824.409548:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480824.409598:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480824.410194:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480824.410246:0:5801:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291744896 00000100:00100000:0.0:1782480824.410257:0:5801:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291744896 00000100:00100000:0.0:1782480824.410342:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 304 00000100:00100000:0.0:1782480824.410354:0:5801:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2369:x1869066291744896:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480824.411289:0:5801:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2369:x1869066291744896:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 919us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480824.411301:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 304 00000100:00100000:0.0:1782480824.411369:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291745280 00000100:00100000:0.0:1782480824.411393:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291745280 00000100:00100000:2.0:1782480824.411591:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291745024 00000100:00100000:2.0:1782480824.411596:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291745024 00000100:00100000:2.0:1782480824.411646:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291745408 00000100:00100000:2.0:1782480824.411650:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291745408 00000100:00100000:2.0:1782480824.411698:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 172 00000100:00100000:2.0:1782480824.411707:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+18:2369:x1869066291745024:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480824.411808:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49099535-dcd3-436f-aa96-9770a3f52e5b+18:2369:x1869066291745024:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 102us (2404us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480824.411815:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 172 00000100:00100000:2.0:1782480824.411847:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 173 00000100:00100000:2.0:1782480824.411854:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+6:2369:x1869066291745408:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480824.411910:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:210e3ff4-fa06-469c-afa9-3e2abcd77331+6:2369:x1869066291745408:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 57us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480824.411916:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 173 00000100:00100000:0.0:1782480824.413029:0:6605:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291745152 00000100:00100000:0.0:1782480824.413039:0:6605:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291745152 00000100:00100000:3.0:1782480824.429117:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 103 00000100:00080000:3.0:1782480824.429980:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782480824.429989:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782480824.429992:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782480824.435628:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fe73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2369:x1869066291745280:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480824.435783:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fe73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2369:x1869066291745280:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 6652us (26280us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480824.435794:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 103 00000100:00100000:2.0:1782480824.435940:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 104 00000100:00100000:2.0:1782480824.435952:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d757c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2369:x1869066291745152:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480824.435996:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d757c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2369:x1869066291745152:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 46us (26397us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480824.436002:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 104 00010000:00010000:3.0:1782480825.014902:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480826.039388:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480827.063163:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480827.127100:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311650688:0@lo:400:kworker.0 00000100:00100000:3.0:1782480827.127181:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480827.127251:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d753fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311650816:0@lo:400:kworker.0 00000100:00100000:3.0:1782480827.127255:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311651200:0@lo:400:kworker.0 00000100:00100000:1.0:1782480827.127292:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480827.127308:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480827.127332:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782480827.127335:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782480827.127342:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311650944:0@lo:400:kworker.0 00000100:00100000:3.0:1782480827.127346:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311650560:0@lo:400:kworker.0 00000100:00100000:0.0:1782480827.127420:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311650688 00000100:00100000:0.0:1782480827.127428:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311650688 00000100:00100000:0.0:1782480827.127490:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311650816 00000100:00100000:0.0:1782480827.127494:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311650816 00000100:00100000:0.0:1782480827.127541:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1782480827.127551:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311650688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480827.127633:0:6602:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311651200 00000100:00100000:2.0:1782480827.127639:0:6602:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311651200 00000100:00100000:2.0:1782480827.127670:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1782480827.127678:0:6602:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4981d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311651200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480827.139093:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480827.139196:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1782480827.139213:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311650816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480827.139294:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311650816:12345-0@lo:400:kworker.0 Request processed in 88us (12002us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480827.139302:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1782480827.139338:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311650944 00000100:00100000:1.0:1782480827.139344:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311650944 00000100:00100000:1.0:1782480827.139388:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782480827.139394:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75f04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311650944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480827.139426:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75f04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311650944:12345-0@lo:400:kworker.0 Request processed in 32us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480827.139446:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1782480827.139501:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311650944:0@lo:400:kworker.0 00000100:00100000:1.0:1782480827.139525:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311650816:0@lo:400:kworker.0 00000100:00080000:1.0:1782480827.139603:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782480827.139618:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782480827.139621:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480827.140817:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480827.140867:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066311651072:0@lo:400:kworker.0 00000100:00100000:3.0:1782480827.140952:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480827.141016:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311651072 00000100:00100000:3.0:1782480827.141023:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311651072 00000100:00100000:3.0:1782480827.141073:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1782480827.141081:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066311651072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480827.141130:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f1c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066311651072:12345-0@lo:400:kworker.0 Request processed in 49us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480827.141138:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:3.0:1782480827.141157:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480827.141186:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066311651072:0@lo:400:kworker.0 00000100:00100000:1.0:1782480827.141485:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311650560 00000100:00100000:1.0:1782480827.141491:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311650560 00000100:00100000:1.0:1782480827.141533:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1782480827.141541:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3316:x1869066311650560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480827.141582:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3316:x1869066311650560:12345-0@lo:400:kworker.0 Request processed in 42us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480827.141589:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1782480827.141679:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311650560:0@lo:400:kworker.0 00000100:00100000:0.0:1782480827.146877:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311650688:12345-0@lo:400:kworker.0 Request processed in 19315us (19683us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480827.146892:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1782480827.147006:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d753f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311650688:0@lo:400:kworker.0 00000100:00100000:2.0:1782480827.155283:0:6602:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4981d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311651200:12345-0@lo:400:kworker.0 Request processed in 27595us (27965us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480827.155299:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782480827.155343:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311651200:0@lo:400:kworker.0 00000100:00100000:1.0:1782480827.639677:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311651328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480827.639804:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480827.640194:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311651328 00000100:00100000:3.0:1782480827.640205:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311651328 00000100:00100000:3.0:1782480827.640276:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782480827.640286:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311651328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782480827.640336:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480827.640398:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311651328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480827.640406:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782480827.640542:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311651328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480828.011317:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480828.017700:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291745664 00000100:00100000:1.0:1782480828.017718:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291745664 00000100:00100000:1.0:1782480828.017825:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:1.0:1782480828.017840:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+18:12319:x1869066291745664:12345-192.168.204.51@tcp:35:umount.0 00000100:00100000:1.0:1782480828.018428:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+19:12319:x1869066291745664:12345-192.168.204.51@tcp:35:umount.0 Request processed in 592us (7119us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1782480828.018437:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00080000:3.0:1782480828.018957:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480828.021975:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480828.022192:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291745920 00000100:00100000:1.0:1782480828.022202:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291745920 00000100:00100000:1.0:1782480828.022262:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:1.0:1782480828.022272:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+19:12319:x1869066291745920:12345-192.168.204.51@tcp:35:umount.0 00000100:00100000:1.0:1782480828.022806:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+20:12319:x1869066291745920:12345-192.168.204.51@tcp:35:umount.0 Request processed in 533us (838us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1782480828.022815:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:0.0:1782480828.028736:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480828.028920:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291746176 00000100:00100000:1.0:1782480828.028931:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291746176 00000100:00100000:1.0:1782480828.028992:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:1.0:1782480828.029003:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45d57850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+20:12319:x1869066291746176:12345-192.168.204.51@tcp:35:umount.0 00000100:00100000:1.0:1782480828.029468:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45d57850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+21:12319:x1869066291746176:12345-192.168.204.51@tcp:35:umount.0 Request processed in 466us (740us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1782480828.029477:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:0.0:1782480828.039007:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480828.039267:0:5810:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291746432 00000100:00100000:1.0:1782480828.039279:0:5810:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291746432 00000100:00100000:1.0:1782480828.039392:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:1.0:1782480828.039403:0:5810:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+21:12319:x1869066291746432:12345-192.168.204.51@tcp:35:umount.0 00000100:00100000:1.0:1782480828.039811:0:5810:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49099535-dcd3-436f-aa96-9770a3f52e5b+22:12319:x1869066291746432:12345-192.168.204.51@tcp:35:umount.0 Request processed in 408us (815us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1782480828.039820:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:2.0:1782480828.049685:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480828.049727:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480828.049807:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480828.054036:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291747072 00000100:00100000:0.0:1782480828.054053:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291747072 00000100:00100000:0.0:1782480828.054207:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291746944 00000100:00100000:0.0:1782480828.054211:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291746944 00000100:00100000:2.0:1782480828.066094:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480828.066599:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291747200 00000100:00100000:1.0:1782480828.066610:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291747200 00000100:00100000:1.0:1782480828.066630:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291746816 00000100:00100000:1.0:1782480828.066633:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291746816 00000100:00100000:1.0:1782480828.066696:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:1.0:1782480828.066707:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+7:2365:x1869066291746816:12345-192.168.204.51@tcp:9:umount.0 00000020:00000080:1.0:1782480828.066739:0:8678:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c023fb5 00000020:00010000:1.0:1782480828.066761:0:8678:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b6d74c72000: total 0 00000100:00080000:1.0:1782480828.066778:0:8678:0:(import.c:65:import_set_state_nolock()) ffff9b6d7f381800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782480828.066815:0:8678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1782480828.067123:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2365:x1869066291746816:12345-192.168.204.51@tcp:9:umount.0 Request processed in 416us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480828.067131:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:1.0:1782480828.067191:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:1.0:1782480828.067199:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+15:2367:x1869066291747072:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480828.067210:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480828.067230:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d82164c00/0x3dc3ebf33c0239db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f735 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480828.067246:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480828.067265:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+14:2367:x1869066291747072:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 67us (17592us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480828.067272:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:1.0:1782480828.067287:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:1.0:1782480828.067294:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+13:2367:x1869066291746944:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480828.067302:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480828.067311:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40031e00/0x3dc3ebf33c023a75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f76d expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480828.067322:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480828.067338:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+12:2367:x1869066291746944:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 44us (17610us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480828.067344:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:1.0:1782480828.067356:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:1.0:1782480828.067362:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+11:2367:x1869066291747200:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480828.067377:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480828.067385:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d582e8c00/0x3dc3ebf33c023c5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f838 expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480828.067393:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480828.067409:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2367:x1869066291747200:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 48us (17602us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480828.067415:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000020:00010000:1.0:1782480828.067569:0:5796:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b6d74c72000: total 0 00010000:00010000:1.0:1782480828.067604:0:5796:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b6d74c72000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1782480828.067648:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b853278/0x3dc3ebf33c0249ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbdb expref: 4 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480828.067677:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054205aa2/0x3dc3ebf33c024351 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa0d expref: 3 pid: 8678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480828.067692:0:5796:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b6d74c72000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1782480828.067704:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480828.067706:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480828.067707:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782480828.067716:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782480828.076406:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480828.076637:0:6604:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291747328 00000100:00100000:3.0:1782480828.076647:0:6604:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291747328 00000100:00100000:3.0:1782480828.076765:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:3.0:1782480828.076790:0:6604:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d753fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+5:2365:x1869066291747328:12345-192.168.204.51@tcp:9:umount.0 00000020:00000080:3.0:1782480828.076821:0:6604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c023d4d 00000100:00080000:3.0:1782480828.076831:0:6604:0:(import.c:65:import_set_state_nolock()) ffff9b6d7b146000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782480828.077641:0:6604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1782480828.078054:0:6604:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d753fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+2:2365:x1869066291747328:12345-192.168.204.51@tcp:9:umount.0 Request processed in 1262us (1654us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480828.078064:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 73 00010000:00010000:3.0:1782480828.078095:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782480828.081827:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782480828.087064:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480828.091157:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480828.091264:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291748352 00000100:00100000:2.0:1782480828.091277:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291748352 00000100:00100000:2.0:1782480828.091374:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 240 00000100:00100000:2.0:1782480828.091387:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+22:2365:x1869066291748352:12345-192.168.204.51@tcp:39:umount.0 00000020:00000080:2.0:1782480828.091423:0:5808:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c0239e9 00000020:00010000:2.0:1782480828.091440:0:5808:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b6c41879000: total 0 00000100:00080000:2.0:1782480828.091446:0:5808:0:(import.c:65:import_set_state_nolock()) ffff9b6c4187d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782480828.091475:0:5808:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1782480828.092382:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49099535-dcd3-436f-aa96-9770a3f52e5b+21:2365:x1869066291748352:12345-192.168.204.51@tcp:39:umount.0 Request processed in 994us (1233us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1782480828.092392:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 240 00000020:00010000:3.0:1782480828.092651:0:5796:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b6c41879000: total 0 00010000:00010000:3.0:1782480828.092697:0:5796:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b6c41879000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1782480828.092797:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:3.0:1782480828.092801:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782480828.092809:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c024010 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f934 expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480828.092832:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b6d45d62c00) 00010000:00010000:3.0:1782480828.092835:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782480828.092839:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9000/0x3dc3ebf33c023cb3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f846 expref: 19 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480828.092857:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:3.0:1782480828.092860:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782480828.092863:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c0243cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa30 expref: 18 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480828.092876:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b6d5230fe00) 00010000:00010000:3.0:1782480828.092878:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782480828.092896:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2de00/0x3dc3ebf33c0246ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb02 expref: 17 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480828.092919:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:3.0:1782480828.092922:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782480828.092926:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c024232 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9c0 expref: 16 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480828.092938:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b6d43255400) 00010000:00010000:3.0:1782480828.092940:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782480828.092944:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d800/0x3dc3ebf33c023d23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f862 expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480828.093007:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:3.0:1782480828.093010:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782480828.093015:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821edc00/0x3dc3ebf33c0248d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fb8e expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480828.093028:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:3.0:1782480828.093030:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480828.093034:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d82165200/0x3dc3ebf33c0249b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbc6 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480828.093047:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d43255700) 00010000:00010000:3.0:1782480828.093050:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782480828.093054:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d200/0x3dc3ebf33c0243b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa29 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480828.093066:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d4bddc700) 00010000:00010000:3.0:1782480828.093074:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480828.093078:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d821ec400/0x3dc3ebf33c023ccf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f84d expref: 11 pid: 10450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480828.093095:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:3.0:1782480828.093098:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1782480828.093101:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c02433c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fa06 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480828.093113:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b6d5230f600) 00010000:00010000:3.0:1782480828.093115:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1782480828.093119:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c0249da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbd4 expref: 9 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480828.093133:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b6d5230fd00) 00010000:00010000:3.0:1782480828.093136:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480828.093139:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024312 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f9f8 expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480828.093149:0:5796:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b6c41879000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1782480828.093162:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480828.093164:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480828.093165:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480829.110934:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480829.175097:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782480829.175125:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311651456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480829.175197:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480829.175256:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311651456 00000100:00100000:3.0:1782480829.175263:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311651456 00000100:00100000:3.0:1782480829.175393:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782480829.175403:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311651456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480829.175438:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480829.175504:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311651456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480829.175511:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1782480829.175585:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480829.175732:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311651456:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1782480829.230471:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 49099535-dcd3-436f-aa96-9770a3f52e5b 00000020:00000080:1.0:1782480829.230479:0:6628:0:(genops.c:906:class_export_put()) final put ffff9b6d7b147000/49099535-dcd3-436f-aa96-9770a3f52e5b 00000020:00000080:2.0:1782480829.230637:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d7b147000/49099535-dcd3-436f-aa96-9770a3f52e5b for lustre-OST0000 00000020:00000080:2.0:1782480829.230930:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6d7b146000 for lustre-OST0000 00000100:00100000:3.0:1782480829.435558:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480829.435680:0:5793:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291748480 00000100:00100000:1.0:1782480829.435691:0:5793:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291748480 00000100:00100000:1.0:1782480829.435801:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:1.0:1782480829.435812:0:5793:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2369:x1869066291748480:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480829.435831:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480829.435860:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d821ec200/0x3dc3ebf33c023abb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f782 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480829.435879:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480829.435949:0:5793:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+9:2369:x1869066291748480:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 140us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480829.435958:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:0.0:1782480829.437448:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480829.437492:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480829.437900:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291748608 00000100:00100000:3.0:1782480829.437911:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291748608 00000100:00100000:3.0:1782480829.437961:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291748736 00000100:00100000:3.0:1782480829.437965:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291748736 00000100:00100000:3.0:1782480829.437996:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:3.0:1782480829.438006:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d684d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+10:2367:x1869066291748608:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480829.438025:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480829.438046:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d6873ce00/0x3dc3ebf33c023ac2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f7ac expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480829.438064:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480829.438115:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d684d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+9:2367:x1869066291748608:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 111us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480829.438123:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:3.0:1782480829.438173:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:3.0:1782480829.438179:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+8:2366:x1869066291748736:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480829.438186:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480829.438195:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d582e8600/0x3dc3ebf33c023c58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f831 expref: 8 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480829.438204:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480829.438222:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+7:2366:x1869066291748736:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 43us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480829.438228:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:0.0:1782480829.446838:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480829.447341:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291748992 00000100:00100000:3.0:1782480829.447351:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291748992 00000100:00100000:3.0:1782480829.447434:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 241 00000100:00100000:3.0:1782480829.447446:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:210e3ff4-fa06-469c-afa9-3e2abcd77331+6:2365:x1869066291748992:12345-192.168.204.51@tcp:39:umount.0 00000020:00000080:3.0:1782480829.447495:0:5807:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c023ad0 00000020:00010000:3.0:1782480829.447503:0:5807:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b6d74e82000: total 0 00000100:00080000:3.0:1782480829.447508:0:5807:0:(import.c:65:import_set_state_nolock()) ffff9b6d74e80800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782480829.447542:0:5807:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1782480829.447838:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:210e3ff4-fa06-469c-afa9-3e2abcd77331+5:2365:x1869066291748992:12345-192.168.204.51@tcp:39:umount.0 Request processed in 393us (1019us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1782480829.447846:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 241 00000020:00010000:0.0:1782480829.448357:0:5795:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b6d74e82000: total 0 00010000:00010000:0.0:1782480829.448362:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480829.448404:0:5795:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b6d74e82000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782480829.448438:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d43255700) 00010000:00010000:0.0:1782480829.448441:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782480829.448450:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c200/0x3dc3ebf33c0249fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbe2 expref: 4 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480829.448475:0:5795:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b6d74e82000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1782480829.448491:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480829.448493:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480829.448495:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782480829.448554:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480829.472249:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480829.472424:0:5799:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291749248 00000100:00100000:2.0:1782480829.472437:0:5799:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291749248 00000100:00100000:2.0:1782480829.472502:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 306 00000100:00100000:2.0:1782480829.472512:0:5799:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+7:2365:x1869066291749248:12345-192.168.204.51@tcp:251:umount.0 00000020:00000080:2.0:1782480829.472574:0:5799:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c0239c6 00000020:00010000:2.0:1782480829.472583:0:5799:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b6d74c74800: total 0 00000100:00080000:2.0:1782480829.472588:0:5799:0:(import.c:65:import_set_state_nolock()) ffff9b6d74c75800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1782480829.472670:0:5799:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5e04a3c2-7108-4d15-9896-eb6ad232c4d6+3:2365:x1869066291749248:12345-192.168.204.51@tcp:251:umount.0 Request processed in 159us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480829.472678:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 306 00000020:00010000:3.0:1782480829.473496:0:5796:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b6d74c74800: total 0 00010000:00010000:3.0:1782480829.473545:0:5796:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b6d74c74800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782480829.473589:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d821ed400/0x3dc3ebf33c023a7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3f774 expref: 2 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480829.473605:0:5796:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b6d74c74800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1782480829.473615:0:5796:0:(genops.c:906:class_export_put()) final put ffff9b6d74c74800/5e04a3c2-7108-4d15-9896-eb6ad232c4d6 00010000:00010000:3.0:1782480829.473641:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480829.473644:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480829.473645:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782480829.475280:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d74c74800/5e04a3c2-7108-4d15-9896-eb6ad232c4d6 for MGS 00000020:00000080:2.0:1782480829.475335:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6d74c75800 for MGS 00010000:00010000:3.0:1782480830.135863:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782480830.763373:0:7497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 49099535-dcd3-436f-aa96-9770a3f52e5b 00000020:00000080:3.0:1782480830.763384:0:7497:0:(genops.c:906:class_export_put()) final put ffff9b6d74c72000/49099535-dcd3-436f-aa96-9770a3f52e5b 00000020:00000080:3.0:1782480830.763412:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d74c72000/49099535-dcd3-436f-aa96-9770a3f52e5b for lustre-OST0001 00000020:00000080:3.0:1782480830.763459:0:485:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6d7f381800 for lustre-OST0001 00000001:00080000:3.0:1782480830.768212:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:3.0:1782480830.768255:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 49099535-dcd3-436f-aa96-9770a3f52e5b 00000001:00080000:3.0:1782480830.768263:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1782480830.768266:0:5829:0:(genops.c:906:class_export_put()) final put ffff9b6c41879000/49099535-dcd3-436f-aa96-9770a3f52e5b 00000001:00100000:3.0:1782480830.768645:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 210e3ff4-fa06-469c-afa9-3e2abcd77331 00000001:00080000:3.0:1782480830.768654:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1782480830.768656:0:5829:0:(genops.c:906:class_export_put()) final put ffff9b6d74e82000/210e3ff4-fa06-469c-afa9-3e2abcd77331 00000020:00000080:0.0:1782480830.769276:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6c41879000/49099535-dcd3-436f-aa96-9770a3f52e5b for lustre-MDT0000 00000020:00000080:0.0:1782480830.769361:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d74e82000/210e3ff4-fa06-469c-afa9-3e2abcd77331 for lustre-MDT0000 00000020:00000080:0.0:1782480830.769386:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6c4187d000 for lustre-MDT0000 00000020:00000080:0.0:1782480830.769392:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6d74e80800 for lustre-MDT0000 00010000:00010000:0.0:1782480831.178542:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782480831.379715:0:12882:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1782480831.413692:0:12882:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1782480831.413775:0:12882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c023a4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a52 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.413791:0:12882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c023a4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023a52 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.413798:0:12882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c023a4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c023a52 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.413806:0:12882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c023a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c023a52 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.413827:0:12882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782480831.413834:0:12882:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1782480831.413855:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782480831.413860:0:12882:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1782480831.413866:0:12882:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1782480831.413891:0:12882:0:(import.c:65:import_set_state_nolock()) ffff9b6d45d6d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1782480831.414028:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480831.414037:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c023a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c023a52 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480831.414061:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d82164800 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:0.0:1782480831.414065:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c023a4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c023a52 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480831.414074:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c023a4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x3dc3ebf33c023a52 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480831.414081:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c023a4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x3dc3ebf33c023a52 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480831.414087:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782480831.414090:0:5796:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1782480831.414092:0:5796:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1782480831.414121:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c023a4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3dc3ebf33c023a52 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480831.414127:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480831.414169:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c023a4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3dc3ebf33c023a52 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480831.414176:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d82164800/0x3dc3ebf33c023a4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3dc3ebf33c023a52 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480831.414189:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480831.414191:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480831.414193:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480831.414200:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782480831.414216:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311651712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480831.414284:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480831.414357:0:5792:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311651712 00000100:00100000:0.0:1782480831.414366:0:5792:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311651712 00000100:00100000:0.0:1782480831.414418:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782480831.414427:0:5792:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75540700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3316:x1869066311651712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782480831.414440:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480831.414454:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d40031800/0x3dc3ebf33c023a52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3dc3ebf33c023a4b expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480831.414467:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480831.414501:0:5792:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75540700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7fffafe6-aedd-4500-93d4-974eea0c11af+18:3316:x1869066311651712:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480831.414509:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782480831.414556:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7fffafe6-aedd-4500-93d4-974eea0c11af:3316:1869066311651712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782480831.414693:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869066311651584:0@lo:39:umount.0 00000100:00100000:2.0:1782480831.414728:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480831.414928:0:10450:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311651584 00000100:00100000:0.0:1782480831.414932:0:10450:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311651584 00000100:00100000:0.0:1782480831.414970:0:10450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1782480831.414977:0:10450:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869066311651584:12345-0@lo:39:umount.0 00000020:00000080:0.0:1782480831.414999:0:10450:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c0237e3 00000100:00080000:0.0:1782480831.415007:0:10450:0:(import.c:65:import_set_state_nolock()) ffff9b6d75902800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1782480831.415066:0:10450:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3314:x1869066311651584:12345-0@lo:39:umount.0 Request processed in 89us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480831.415073:0:10450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1782480831.415079:0:10450:0:(genops.c:906:class_export_put()) final put ffff9b6d75906000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1782480831.415104:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d75906000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:3.0:1782480831.415194:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782480831.415233:0:485:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6d75902800 for lustre-MDT0000 00000100:00080000:0.0:1782480831.415263:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9b6d45d6d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1782480831.415279:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869066311651584:0@lo:39:umount.0 00000100:00080000:3.0:1782480831.415332:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782480831.415335:0:12882:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1782480831.415340:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1782480831.417653:0:12882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d40031200/0x3dc3ebf33c023a59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a60 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.417778:0:12882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d40031200/0x3dc3ebf33c023a59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023a60 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.417789:0:12882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d40031200/0x3dc3ebf33c023a59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c023a60 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.417796:0:12882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9b6d40031200/0x3dc3ebf33c023a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c023a60 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.417814:0:12882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782480831.417821:0:12882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873ca00/0x3dc3ebf33c023980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023987 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.417828:0:12882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873ca00/0x3dc3ebf33c023980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023987 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.417834:0:12882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873ca00/0x3dc3ebf33c023980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c023987 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.417841:0:12882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9b6d6873ca00/0x3dc3ebf33c023980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c023987 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.417858:0:12882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782480831.417866:0:12882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c023c82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023c89 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.417872:0:12882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c023c82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023c89 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.417892:0:12882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c023c82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c023c89 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.417898:0:12882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c023c82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c023c89 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.417913:0:12882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1782480831.417924:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782480831.417930:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d40031200/0x3dc3ebf33c023a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c023a60 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.417937:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40031200 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:3.0:1782480831.417940:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d40031200/0x3dc3ebf33c023a59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c023a60 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.417949:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d40031200/0x3dc3ebf33c023a59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x3dc3ebf33c023a60 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480831.417957:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d40031200/0x3dc3ebf33c023a59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x3dc3ebf33c023a60 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480831.417963:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782480831.417965:0:7486:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1782480831.417999:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d40031200/0x3dc3ebf33c023a59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3dc3ebf33c023a60 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418005:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480831.418026:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d40031200/0x3dc3ebf33c023a59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3dc3ebf33c023a60 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418045:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d40031200/0x3dc3ebf33c023a59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3dc3ebf33c023a60 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418060:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782480831.418064:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d6873ca00/0x3dc3ebf33c023980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c023987 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418070:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6873ca00 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:3.0:1782480831.418073:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6873ca00/0x3dc3ebf33c023980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c023987 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418080:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d6873ca00/0x3dc3ebf33c023980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3dc3ebf33c023987 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480831.418087:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6873ca00/0x3dc3ebf33c023980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3dc3ebf33c023987 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480831.418092:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1782480831.418095:0:7486:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1782480831.418097:0:7486:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1782480831.418113:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d6873ca00/0x3dc3ebf33c023980 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3dc3ebf33c023987 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418119:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480831.418146:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d6873ca00/0x3dc3ebf33c023980 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3dc3ebf33c023987 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418153:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d6873ca00/0x3dc3ebf33c023980 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3dc3ebf33c023987 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418177:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480831.418180:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c023c82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c023c89 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418186:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9a00 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:3.0:1782480831.418189:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c023c82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c023c89 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418195:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c023c82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3dc3ebf33c023c89 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480831.418202:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c023c82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3dc3ebf33c023c89 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480831.418206:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1782480831.418209:0:7486:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1782480831.418211:0:7486:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1782480831.418223:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c023c82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3dc3ebf33c023c89 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418228:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480831.418234:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c023c82 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3dc3ebf33c023c89 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418240:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c023c82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3dc3ebf33c023c89 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418246:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480831.418248:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480831.418254:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480831.418262:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480831.418280:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311651840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782480831.418345:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782480831.418396:0:12882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d40031400/0x3dc3ebf33c023734 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c02373b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418405:0:12882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d40031400/0x3dc3ebf33c023734 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c02373b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418411:0:12882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d40031400/0x3dc3ebf33c023734 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c02373b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418417:0:12882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9b6d40031400/0x3dc3ebf33c023734 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c02373b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418429:0:12882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782480831.418432:0:12882:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1782480831.418435:0:12882:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1782480831.418457:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480831.418461:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d40031400/0x3dc3ebf33c023734 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c02373b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418466:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d40031400 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:3.0:1782480831.418469:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d40031400/0x3dc3ebf33c023734 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c02373b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418477:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d40031400/0x3dc3ebf33c023734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3dc3ebf33c02373b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480831.418483:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d40031400/0x3dc3ebf33c023734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3dc3ebf33c02373b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480831.418493:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1782480831.418496:0:7486:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1782480831.418497:0:7486:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1782480831.418511:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d40031400/0x3dc3ebf33c023734 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3dc3ebf33c02373b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418516:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480831.418537:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d40031400/0x3dc3ebf33c023734 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3dc3ebf33c02373b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418544:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d40031400/0x3dc3ebf33c023734 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3dc3ebf33c02373b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480831.418557:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480831.418559:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480831.418561:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480831.418572:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311652224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782480831.418596:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1782480831.418627:0:12882:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1782480831.418631:0:12882:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1782480831.418635:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782480831.418641:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1782480831.418645:0:12882:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9b6d7f11a800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782480831.418651:0:12882:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9b6d7af57000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782480831.418656:0:12882:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9b6d48458000) has exports, disconnecting them 00000020:00080000:3.0:1782480831.418661:0:12882:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b6d7f11a800), last request at 1782480827 00000020:00000080:3.0:1782480831.418668:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c023948 00010000:00010000:0.0:1782480831.419179:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480831.419197:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311651840 00000100:00100000:0.0:1782480831.419204:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311651840 00000100:00100000:0.0:1782480831.419246:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311652224 00000100:00100000:0.0:1782480831.419249:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311652224 00000100:00100000:0.0:1782480831.419272:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782480831.419280:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+19:3315:x1869066311651840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782480831.419293:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480831.419307:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d413f5e00/0x3dc3ebf33c023a60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3dc3ebf33c023a59 expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480831.419321:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480831.419366:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+18:3315:x1869066311651840:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480831.419373:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782480831.419389:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782480831.419395:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+17:3315:x1869066311652224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782480831.419402:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480831.419410:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d821ed000/0x3dc3ebf33c02373b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3dc3ebf33c023734 expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480831.419421:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480831.419441:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7fffafe6-aedd-4500-93d4-974eea0c11af+16:3315:x1869066311652224:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480831.419447:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782480831.419485:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311652224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480831.419494:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311651840:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782480831.419729:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480831.419743:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d460b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311652096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782480831.419803:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480831.419836:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782480831.419842:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311651968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782480831.419863:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480831.419887:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311652096 00000100:00100000:2.0:1782480831.419891:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311652096 00000100:00100000:2.0:1782480831.419917:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311651968 00000100:00100000:2.0:1782480831.419920:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311651968 00000100:00100000:2.0:1782480831.419934:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782480831.419941:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fffafe6-aedd-4500-93d4-974eea0c11af+17:3318:x1869066311652096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782480831.419949:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480831.419958:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d582e8e00/0x3dc3ebf33c023c89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3dc3ebf33c023c82 expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480831.419969:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480831.419996:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fffafe6-aedd-4500-93d4-974eea0c11af+16:3318:x1869066311652096:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480831.420003:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782480831.420015:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782480831.420022:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fffafe6-aedd-4500-93d4-974eea0c11af+15:3318:x1869066311651968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782480831.420030:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480831.420045:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d821ed200/0x3dc3ebf33c023987 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3dc3ebf33c023980 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480831.420057:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480831.420079:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7fffafe6-aedd-4500-93d4-974eea0c11af+14:3318:x1869066311651968:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480831.420086:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782480831.420115:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311651968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782480831.420124:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d460b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7fffafe6-aedd-4500-93d4-974eea0c11af:3318:1869066311652096:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1782480831.421773:0:12882:0:(import.c:65:import_set_state_nolock()) ffff9b6d7f118000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1782480831.421843:0:12882:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b6d7f11a800): rc 0 00000020:00000080:3.0:1782480831.421846:0:12882:0:(genops.c:906:class_export_put()) final put ffff9b6d7f11a800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:1.0:1782480831.421891:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1782480831.426055:0:12882:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b6d7af57000), last request at 1782480827 00000020:00000080:3.0:1782480831.426071:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c02387d 00000100:00080000:3.0:1782480831.426087:0:12882:0:(import.c:65:import_set_state_nolock()) ffff9b6d7af50000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1782480831.426117:0:12882:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b6d7af57000): rc 0 00000020:00000080:3.0:1782480831.426120:0:12882:0:(genops.c:906:class_export_put()) final put ffff9b6d7af57000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1782480831.426141:0:12882:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb4ff43aabae0 00000100:00080000:3.0:1782480831.426168:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1782480831.426173:0:12882:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1782480831.426190:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1782480831.426273:0:12882:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1782480831.426299:0:12882:0:(import.c:65:import_set_state_nolock()) ffff9b6d7f627000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1782480831.426314:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1782480831.426317:0:12882:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1782480831.426324:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1782480831.426377:0:12882:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1782480831.426386:0:12882:0:(import.c:65:import_set_state_nolock()) ffff9b6d75818000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1782480831.426467:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9b6d48458000) has no exports 00000020:00000080:1.0:1782480831.426535:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d7f11a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1782480831.426589:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d7af57000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1782480831.426610:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6d7f118000 for lustre-MDT0000 00000020:00000080:1.0:1782480831.426614:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6d7af50000 for lustre-MDT0000 00010000:00010000:2.0:1782480831.426661:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480831.427103:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1869066311652352:0@lo:9:umount.0 00000100:00100000:0.0:1782480831.427182:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480831.427210:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1869066311652480:0@lo:9:umount.0 00000100:00100000:0.0:1782480831.427232:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480831.427657:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311652352 00000100:00100000:1.0:1782480831.427666:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311652352 00000100:00100000:1.0:1782480831.427740:0:8678:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311652480 00000100:00100000:1.0:1782480831.427763:0:8678:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311652480 00000100:00100000:1.0:1782480831.427794:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782480831.427802:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869066311652352:12345-0@lo:9:umount.0 00000020:00000080:1.0:1782480831.427827:0:8678:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c0238ca 00000100:00080000:1.0:1782480831.427843:0:8678:0:(import.c:65:import_set_state_nolock()) ffff9b6d7f385800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782480831.427872:0:8678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1782480831.428180:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3314:x1869066311652352:12345-0@lo:9:umount.0 Request processed in 377us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480831.428188:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782480831.428202:0:8678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782480831.428208:0:8678:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869066311652480:12345-0@lo:9:umount.0 00000020:00000080:1.0:1782480831.428219:0:8678:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c0239b1 00000100:00080000:1.0:1782480831.428224:0:8678:0:(import.c:65:import_set_state_nolock()) ffff9b6c4187c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782480831.428240:0:8678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1782480831.428418:0:8678:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3314:x1869066311652480:12345-0@lo:9:umount.0 Request processed in 209us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480831.428424:0:8678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1782480831.428446:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782480831.428471:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9b6d7f627000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1782480831.428482:0:3314:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1782480831.428484:0:3314:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782480831.428487:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1869066311652352:0@lo:9:umount.0 00000100:00080000:1.0:1782480831.428496:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9b6d75818000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1782480831.428502:0:3314:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1782480831.428504:0:3314:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782480831.428506:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1869066311652480:0@lo:9:umount.0 00010000:00010000:1.0:1782480831.428543:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782480831.428646:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782480831.428650:0:5803:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:2.0:1782480831.440267:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9b6d48458000) has no exports 00000020:00000080:2.0:1782480831.485325:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c02378f 00000020:00000080:2.0:1782480831.485342:0:12882:0:(genops.c:906:class_export_put()) final put ffff9b6d6e555800/lustre-QMT0000_UUID 00000020:01000000:2.0:1782480831.485365:0:12882:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1782480831.485516:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d6e555800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1782480831.485554:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782480831.485564:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1782480831.485568:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9b6d47dd19c0) has no exports 00000020:00000080:3.0:1782480831.486043:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c023788 00000020:00000080:3.0:1782480831.486049:0:12882:0:(genops.c:906:class_export_put()) final put ffff9b6d6e54e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1782480831.486103:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782480831.486110:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1782480831.486113:0:12882:0:(genops.c:906:class_export_put()) final put ffff9b6d6e54b800/lustre-QMT0000_UUID 00000020:00000080:3.0:1782480831.486115:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d6e54b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1782480831.486119:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1782480831.486292:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d6e54e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1782480831.486405:0:12882:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b6d51ed6180 - data ffff9b6d7f823360/ffff9b6d7f210c00 00000020:01000000:3.0:1782480831.486542:0:12882:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b6d485d3b40 - data ffff9b6d658ef1b0/ffff9b6d7bc5f400 00000001:00000004:3.0:1782480831.514095:0:12882:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1782480831.595457:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1782480831.595467:0:12882:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1782480831.595499:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782480831.595501:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1782480831.600585:0:6880:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1782480831.600596:0:6880:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1782480831.600610:0:6880:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1782480831.602645:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1782480831.602653:0:12882:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1782480831.602719:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782480831.602722:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1782480831.603710:0:7922:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1782480831.603715:0:7922:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1782480831.603726:0:7922:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1782480831.655393:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c023757 00000020:00000080:2.0:1782480831.655407:0:12882:0:(genops.c:906:class_export_put()) final put ffff9b6d68518000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1782480831.655604:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d68518000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1782480831.658002:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c02376c 00000020:00000080:2.0:1782480831.658016:0:12882:0:(genops.c:906:class_export_put()) final put ffff9b6d6851d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1782480831.658032:0:12882:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1782480831.658038:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782480831.658056:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782480831.658060:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9b6d4845b380) has no exports 00000004:01000000:2.0:1782480831.658259:0:12882:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1782480831.658340:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c0239aa 00000020:00000080:2.0:1782480831.658346:0:12882:0:(genops.c:906:class_export_put()) final put ffff9b6d7563a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1782480831.658350:0:12882:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1782480831.658354:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782480831.658360:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1782480831.658363:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9b6d7562b380) has no exports 00000020:00000080:2.0:1782480831.658369:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c0239a3 00000020:00000080:2.0:1782480831.658372:0:12882:0:(genops.c:906:class_export_put()) final put ffff9b6d7563e800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1782480831.658707:0:12882:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1782480831.658712:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1782480831.658717:0:12882:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1782480831.658723:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782480831.658725:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782480831.658784:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782480831.658791:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782480831.658796:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c0238c3 00000020:00000080:2.0:1782480831.658800:0:12882:0:(genops.c:906:class_export_put()) final put ffff9b6d74c76800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1782480831.658804:0:12882:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1782480831.658808:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782480831.658811:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1782480831.658813:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9b6d7f698000) has no exports 00000020:00000080:2.0:1782480831.658817:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c0238bc 00000020:00000080:2.0:1782480831.658820:0:12882:0:(genops.c:906:class_export_put()) final put ffff9b6d7f620000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1782480831.659142:0:12882:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1782480831.659145:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1782480831.659147:0:12882:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1782480831.659150:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1782480831.659152:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782480831.659177:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782480831.659191:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782480831.659217:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782480831.659221:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782480831.659245:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c023773 00000020:00000080:2.0:1782480831.659250:0:12882:0:(genops.c:906:class_export_put()) final put ffff9b6d6851e800/lustre-MDD0000_UUID 00000020:01000000:2.0:1782480831.659256:0:12882:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1782480831.659259:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782480831.659263:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782480831.659265:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9b6d6d893380) has no exports 00000020:00000080:2.0:1782480831.659875:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782480831.659881:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1782480831.659885:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c02377a 00000020:00000080:2.0:1782480831.659889:0:12882:0:(genops.c:906:class_export_put()) final put ffff9b6d68519000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1782480831.659901:0:12882:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b6d47c9a800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1782480831.659905:0:12882:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9b6d47c9a800 3 00000020:01000004:2.0:1782480831.659908:0:12882:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b6d47c9a800 from lustre-MDT0000 00000020:00000080:2.0:1782480831.659925:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782480831.659929:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1782480831.659931:0:12882:0:(genops.c:906:class_export_put()) final put ffff9b6d6851f000/lustre-MDT0000_UUID 00000020:00000080:2.0:1782480831.659934:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d6851f000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1782480831.659945:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1782480831.660008:0:12882:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1782480831.660012:0:12882:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1782480831.660015:0:12882:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1782480831.660018:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782480831.660021:0:12882:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1782480831.660027:0:12882:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9b6d45cef000 7fffafe6-aedd-4500-93d4-974eea0c11af 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782480831.660034:0:12882:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9b6d47dd0000) has exports, disconnecting them 00000020:00080000:2.0:1782480831.660038:0:12882:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9b6d45cef000), last request at 1782480596 00000020:00000080:2.0:1782480831.660051:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c023718 00000020:00010000:2.0:1782480831.660055:0:12882:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b6d45cef000: total 7 00000100:00080000:2.0:1782480831.660059:0:12882:0:(import.c:65:import_set_state_nolock()) ffff9b6d45ce8000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1782480831.660095:0:12882:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b6d45cef000): rc 0 00000020:00080000:2.0:1782480831.660099:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9b6d47dd0000) has no exports 00000100:00100000:2.0:1782480831.660159:0:5802:0:(service.c:3182:ptlrpc_main()) ll_mgs_0002: service thread [ffff9b6d45d66000:5802] 2 exiting: rc = 0 00000100:00100000:2.0:1782480831.660249:0:5799:0:(service.c:3182:ptlrpc_main()) ll_mgs_0000: service thread [ffff9b6d68d00800:5799] 0 exiting: rc = 1 00000020:00000080:0.0:1782480831.660381:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d6851d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1782480831.660387:0:485:0:(genops.c:906:class_export_put()) final put ffff9b6d7a8cb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782480831.660389:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d7a8cb000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1782480831.660393:0:485:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782480831.660543:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d7563a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1782480831.660549:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d7563e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1782480831.660553:0:485:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6d75818000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1782480831.660558:0:485:0:(genops.c:906:class_export_put()) final put ffff9b6d75639000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782480831.660560:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d75639000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1782480831.660563:0:485:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782480831.660594:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d74c76800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1782480831.660600:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d7f620000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1782480831.660606:0:485:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6d7f627000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1782480831.660610:0:485:0:(genops.c:906:class_export_put()) final put ffff9b6d7af55800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782480831.660620:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d7af55800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1782480831.660623:0:485:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782480831.660690:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d6851e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1782480831.660695:0:485:0:(genops.c:906:class_export_put()) final put ffff9b6d6851a000/lustre-MDD0000_UUID 00000020:00000080:0.0:1782480831.660697:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d6851a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1782480831.660701:0:485:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1782480831.660910:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d68519000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1782480831.661111:0:5795:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b6d45cef000: total 0 00010000:00010000:1.0:1782480831.661142:0:5795:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b6d45cef000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1782480831.661174:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d6e573400/0x3dc3ebf33c023c7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3dc3ebf33c023c74 expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480831.661192:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d413f5a00/0x3dc3ebf33c023830 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3dc3ebf33c023829 expref: 8 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480831.661217:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d821ed600/0x3dc3ebf33c023a6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3dc3ebf33c023a67 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480831.661228:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d413f5c00/0x3dc3ebf33c023a1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3dc3ebf33c023a13 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480831.661238:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d6873de00/0x3dc3ebf33c023a28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3dc3ebf33c023a21 expref: 5 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480831.661249:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d82165a00/0x3dc3ebf33c023a36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3dc3ebf33c023a2f expref: 4 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480831.661260:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d413f4e00/0x3dc3ebf33c023a44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3dc3ebf33c023a3d expref: 3 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480831.661350:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d821ece00/0x3dc3ebf33c023c6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3dc3ebf33c023c66 expref: 2 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480831.661363:0:5795:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b6d45cef000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1782480831.661379:0:5795:0:(genops.c:906:class_export_put()) final put ffff9b6d45cef000/7fffafe6-aedd-4500-93d4-974eea0c11af 00010000:00010000:1.0:1782480831.661400:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480831.661402:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480831.661404:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782480831.661588:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d45cef000/7fffafe6-aedd-4500-93d4-974eea0c11af for MGS 00000100:00100000:3.0:1782480831.661794:0:5801:0:(service.c:3182:ptlrpc_main()) ll_mgs_0001: service thread [ffff9b6d46011800:5801] 1 exiting: rc = 0 00000020:00000080:0.0:1782480831.662446:0:485:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6d45ce8000 for MGS 00000100:00100000:2.0:1782480831.663023:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663032:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663037:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663044:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663049:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663056:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663061:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663066:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663072:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663077:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663083:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663088:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663094:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663100:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663105:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663110:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663116:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663122:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663127:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663134:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663139:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663145:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663150:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663157:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663162:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663167:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663173:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663178:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663183:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663188:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663206:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663212:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663217:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663222:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663228:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663234:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663240:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663245:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663251:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663256:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663262:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663279:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663285:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663291:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663297:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663302:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663307:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663313:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663317:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663323:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663329:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663334:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663339:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663345:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663350:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663356:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663361:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663367:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663374:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663380:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663386:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663392:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663397:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.663403:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1782480831.664055:0:12882:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1782480831.664066:0:12882:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1782480831.664961:0:12882:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b6c42a92780 - data ffff9b6c415f0438/ffff9b6d75933000 00000020:01000000:2.0:1782480831.665109:0:12882:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b6d657dccc0 - data ffff9b6d4953d798/ffff9b6d45cf0800 00000020:00000080:2.0:1782480831.666158:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c0236fc 00000020:00000080:2.0:1782480831.666167:0:12882:0:(genops.c:906:class_export_put()) final put ffff9b6d657b5800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1782480831.666191:0:12882:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b6d47c9a800 from MGS, refs=2 00000020:01000004:2.0:1782480831.666195:0:12882:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9b6d47c9a800 2 00000020:01000004:2.0:1782480831.666198:0:12882:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b6d47c9a800 from MGS 00000020:00000080:2.0:1782480831.666218:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782480831.666225:0:12882:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1782480831.666228:0:12882:0:(genops.c:906:class_export_put()) final put ffff9b6d657b0800/MGS 00000020:00000080:2.0:1782480831.666231:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d657b0800/MGS for MGS 00000020:01000000:2.0:1782480831.666237:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:0.0:1782480831.666341:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d657b5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1782480831.666419:0:12882:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1782480831.666425:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782480831.666432:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1782480831.666442:0:12882:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9b6d45d68000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1782480831.666448:0:12882:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9b6d460b99c0) has exports, disconnecting them 00000020:00080000:2.0:1782480831.666454:0:12882:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9b6d45d68000), last request at 1782480597 00000020:00000080:2.0:1782480831.666458:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c0237c7 00000020:00080000:2.0:1782480831.666470:0:12882:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b6d45d68000): rc 0 00000020:00000080:2.0:1782480831.666475:0:12882:0:(genops.c:906:class_export_put()) final put ffff9b6d45d68000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1782480831.668051:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d45d68000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1782480831.681585:0:12882:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1782480831.681597:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782480831.681603:0:12882:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1782480831.681611:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782480831.681870:0:485:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6d45d6d000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1782480831.681952:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782480831.681961:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1782480831.681967:0:12882:0:(genops.c:906:class_export_put()) final put ffff9b6d50793000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1782480831.681972:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d50793000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1782480831.681982:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1782480831.682179:0:12882:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9b6d47c9a800 1 00000020:00000080:2.0:1782480831.682187:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c0236ee 00000020:00000080:2.0:1782480831.682194:0:12882:0:(genops.c:906:class_export_put()) final put ffff9b6d657b5000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1782480831.682233:0:12882:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1782480831.682238:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782480831.682243:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782480831.682247:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9b6d484599c0) has no exports 00000020:00000080:0.0:1782480831.686713:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d657b5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1782480831.695051:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782480831.695067:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1782480831.695072:0:12882:0:(genops.c:906:class_export_put()) final put ffff9b6d47c9a000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1782480831.695078:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d47c9a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1782480831.695087:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1782480831.695226:0:12882:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9b6d47c9e000 00000020:01000000:1.0:1782480831.695257:0:12882:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1782480831.695261:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782480831.695265:0:12882:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1782480831.695268:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9b6d460b8000) has no exports 00000100:00100000:1.0:1782480831.695343:0:5809:0:(service.c:3182:ptlrpc_main()) mdt00_002: service thread [ffff9b6d4526ee00:5809] 2 exiting: rc = 0 00000100:00100000:2.0:1782480831.696491:0:5808:0:(service.c:3182:ptlrpc_main()) mdt00_001: service thread [ffff9b6d4526fa00:5808] 1 exiting: rc = 0 00000100:00100000:2.0:1782480831.696583:0:11544:0:(service.c:3182:ptlrpc_main()) mdt00_004: service thread [ffff9b6d7607b200:11544] 4 exiting: rc = 0 00000100:00100000:3.0:1782480831.696817:0:5807:0:(service.c:3182:ptlrpc_main()) mdt00_000: service thread [ffff9b6d4526f600:5807] 0 exiting: rc = 1 00000100:00100000:1.0:1782480831.697925:0:10450:0:(service.c:3182:ptlrpc_main()) mdt00_003: service thread [ffff9b6d4604ce00:10450] 3 exiting: rc = 0 00000100:00100000:2.0:1782480831.698903:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.698912:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.698920:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.698926:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.698932:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.698936:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.698941:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.698946:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.698951:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.698956:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.698961:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.698967:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.698972:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.698978:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.698983:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.698988:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.698993:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.698999:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699006:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699011:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699017:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699022:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699027:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699033:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699038:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699060:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699065:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699070:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699075:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699081:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699086:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699091:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699097:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699103:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699109:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699114:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699119:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699125:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699129:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699134:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699139:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699144:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699149:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699153:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699159:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699163:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699168:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699173:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699179:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699185:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699191:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699197:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699202:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699207:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699212:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699217:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699221:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699226:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699231:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699235:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699248:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699253:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699258:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.699263:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.705277:0:5811:0:(service.c:3182:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9b6d4526e400:5811] 1 exiting: rc = 0 00000100:00100000:1.0:1782480831.705471:0:5810:0:(service.c:3182:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9b6d4526ec00:5810] 0 exiting: rc = 1 00000100:00100000:2.0:1782480831.706037:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706045:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706051:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706056:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706062:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706068:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706075:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706082:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706091:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706100:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706107:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706114:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706121:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706126:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706132:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706137:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706143:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706148:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706153:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706158:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706163:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706167:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706172:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706178:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706183:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706188:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706193:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706198:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706203:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706209:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706214:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706232:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706237:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706243:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706249:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706255:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706260:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706265:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706271:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706276:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706282:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706287:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706292:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706297:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706301:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706306:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706311:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706316:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706320:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706325:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706330:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706336:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706341:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706346:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706351:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706355:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706360:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706364:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706369:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706373:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706378:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706383:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706388:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.706392:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707008:0:5812:0:(service.c:3182:ptlrpc_main()) mdt_out00_000: service thread [ffff9b6d4526fc00:5812] 0 exiting: rc = 1 00000100:00100000:1.0:1782480831.707159:0:5813:0:(service.c:3182:ptlrpc_main()) mdt_out00_001: service thread [ffff9b6d4526f400:5813] 1 exiting: rc = 0 00000100:00100000:0.0:1782480831.707245:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707253:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707266:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707274:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707280:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707286:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707292:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707304:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707310:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707315:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707321:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707327:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707332:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707337:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707347:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707360:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707365:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707372:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707378:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707397:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707404:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707410:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707416:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707423:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707430:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707436:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707442:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707448:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707455:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707463:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707469:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707489:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707496:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707502:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707509:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707515:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707532:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707538:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707543:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707550:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707556:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707562:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707570:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707588:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707594:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707601:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707607:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707615:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707621:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707627:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707639:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707646:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707651:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707659:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707666:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707684:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707692:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707697:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707706:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707714:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707721:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707729:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707735:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.707742:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.716210:0:5814:0:(service.c:3182:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9b6d4856f000:5814] 0 exiting: rc = 1 00000100:00100000:0.0:1782480831.716333:0:5815:0:(service.c:3182:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9b6d4526f200:5815] 1 exiting: rc = 0 00000100:00100000:1.0:1782480831.716430:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716439:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716445:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716450:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716455:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716459:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716465:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716470:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716475:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716481:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716488:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716496:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716501:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716505:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716510:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716514:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716531:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716537:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716542:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716546:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716551:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716556:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716562:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716567:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716572:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716577:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716597:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716602:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716607:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716612:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716617:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716622:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716627:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716632:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716638:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716643:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716648:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716654:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716658:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716663:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716667:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716671:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716677:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716681:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716686:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716691:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716697:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716701:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716707:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716712:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716719:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716724:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716730:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716734:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716739:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716898:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716907:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716911:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716915:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716919:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716923:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716936:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716940:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.716944:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.717341:0:5817:0:(service.c:3182:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9b6d43693c00:5817] 1 exiting: rc = 0 00000100:00100000:2.0:1782480831.719961:0:5816:0:(service.c:3182:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9b6d4608ea00:5816] 0 exiting: rc = 1 00000100:00100000:0.0:1782480831.720141:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720149:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720155:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720161:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720165:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720170:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720176:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720181:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720186:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720192:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720197:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720202:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720207:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720213:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720218:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720223:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720229:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720234:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720240:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720256:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720262:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720267:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720272:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720277:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720282:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720287:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720292:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720298:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720303:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720308:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720313:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720318:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720323:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720327:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720333:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720338:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720343:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720348:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720354:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720359:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720364:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720370:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720375:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720380:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720386:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720391:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720396:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720401:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720407:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720412:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720417:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720422:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720427:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720432:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720446:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720450:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720455:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720459:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720464:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720469:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720474:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720479:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720484:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.720490:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480831.721352:0:5818:0:(service.c:3182:ptlrpc_main()) mdt_fld_0000: service thread [ffff9b6d4608e600:5818] 0 exiting: rc = 1 00000100:00100000:3.0:1782480831.721451:0:5819:0:(service.c:3182:ptlrpc_main()) mdt_fld_0001: service thread [ffff9b6d4608ec00:5819] 1 exiting: rc = 0 00000100:00100000:0.0:1782480831.721912:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.721918:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.721923:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.721929:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.721934:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.721940:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.721945:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.721950:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.721955:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.721960:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.721966:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.721971:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.721976:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.721982:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.721987:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.721991:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.721996:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722001:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722006:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722011:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722016:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722021:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722026:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722030:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722035:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722049:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722055:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722059:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722064:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722070:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722074:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722078:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722083:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722087:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722093:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722098:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722103:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722108:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722114:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722119:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722124:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722129:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722134:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722138:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722142:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722147:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722151:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722156:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722161:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722166:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722171:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722176:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722180:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722185:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722190:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722195:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722200:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722204:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722209:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722213:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722225:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722230:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722236:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.722240:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480831.723448:0:5820:0:(service.c:3182:ptlrpc_main()) mdt_io00_000: service thread [ffff9b6d79c4ba00:5820] 0 exiting: rc = 1 00000100:00100000:0.0:1782480831.724039:0:5822:0:(service.c:3182:ptlrpc_main()) mdt_io00_002: service thread [ffff9b6d79c6f600:5822] 2 exiting: rc = 0 00000100:00100000:2.0:1782480831.724158:0:5821:0:(service.c:3182:ptlrpc_main()) mdt_io00_001: service thread [ffff9b6d79c6f200:5821] 1 exiting: rc = 0 00000100:00100000:0.0:1782480831.724607:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724614:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724621:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724627:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724632:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724638:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724644:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724652:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724659:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724665:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724671:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724678:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724685:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724691:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724697:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724712:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724719:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724724:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724730:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724735:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724741:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724778:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724901:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724907:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724912:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724917:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724922:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724928:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724933:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724939:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724959:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724966:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724972:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724978:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724985:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724989:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.724995:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725004:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725011:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725032:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725039:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725045:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725050:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725056:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725062:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725069:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725077:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725083:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725088:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725094:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725101:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725106:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725112:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725118:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725127:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725133:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725139:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725146:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725151:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725158:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725165:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725171:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725177:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480831.725194:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1782480831.738229:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782480831.738243:0:12882:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1782480831.738248:0:12882:0:(genops.c:906:class_export_put()) final put ffff9b6d465b7000/MDS_uuid 00000020:00000080:1.0:1782480831.738253:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d465b7000/MDS_uuid for MDS 00000020:01000000:1.0:1782480831.738262:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1782480831.738412:0:12882:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1782480832.185625:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480832.248050:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311652736:0@lo:400:kworker.0 00000400:00000100:0.0:1782480832.248120:0:3317:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869066311652736 offset 0 length 224: 4 00000100:00100000:0.0:1782480832.248182:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480832.248189:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311652864:0@lo:400:kworker.0 00000400:00000100:0.0:1782480832.248208:0:3317:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869066311652864 offset 0 length 224: 4 00000100:00100000:3.0:1782480832.248266:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480832.248277:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311652608:0@lo:400:kworker.0 00000400:00000100:3.0:1782480832.248312:0:3315:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869066311652608 offset 0 length 224: 4 00010000:00010000:0.0:1782480833.207918:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480834.239255:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782480834.371379:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1782480834.371389:0:6628:0:(genops.c:906:class_export_put()) final put ffff9b6d7f381000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782480834.371482:0:485:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d7f381000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1782480834.371535:0:485:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6d7f385800 for lustre-OST0000 00000020:01000004:2.0:1782480834.682244:0:13035:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1782480834.700412:0:13035:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1782480834.700965:0:13035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d400/0x3dc3ebf33c023a2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a36 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480834.700981:0:13035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d400/0x3dc3ebf33c023a2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023a36 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480834.700988:0:13035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d400/0x3dc3ebf33c023a2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c023a36 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480834.700994:0:13035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d400/0x3dc3ebf33c023a2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c023a36 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480834.701022:0:13035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782480834.701028:0:13035:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1782480834.701049:0:13035:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782480834.701061:0:13035:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b6d750f9f80 x1869066311652736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480848 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480834.701076:0:13035:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1782480834.701081:0:13035:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1782480834.701108:0:13035:0:(import.c:65:import_set_state_nolock()) ffff9b6d7af53000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1782480834.701201:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1869066311652992:0@lo:39:umount.0 00000400:00000100:1.0:1782480834.701253:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869066311652992 offset 0 length 224: 4 00010000:00010000:3.0:1782480834.701436:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480834.701443:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d400/0x3dc3ebf33c023a2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c023a36 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480834.701451:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6873d400 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:3.0:1782480834.701455:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d400/0x3dc3ebf33c023a2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c023a36 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480834.701484:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d400/0x3dc3ebf33c023a2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x3dc3ebf33c023a36 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480834.701490:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d400/0x3dc3ebf33c023a2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x3dc3ebf33c023a36 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480834.701496:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782480834.701499:0:5796:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1782480834.701617:0:5796:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1782480834.701644:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d400/0x3dc3ebf33c023a2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3dc3ebf33c023a36 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480834.701665:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480834.701693:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d400/0x3dc3ebf33c023a2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3dc3ebf33c023a36 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480834.701700:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d400/0x3dc3ebf33c023a2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3dc3ebf33c023a36 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480834.701711:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480834.701713:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480834.701715:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480834.701738:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311652736:0@lo:400:kworker.0 00000100:00100000:1.0:1782480834.702180:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311653120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782480834.702223:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480834.702368:0:8304:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311653120 00000100:00100000:2.0:1782480834.702375:0:8304:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311653120 00000100:00100000:2.0:1782480834.702480:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782480834.702488:0:8304:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d684d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3315:x1869066311653120:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1782480834.702512:0:8304:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782480834 with bad export cookie 4450660286688540440 00000100:00100000:2.0:1782480834.712154:0:8304:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d684d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3315:x1869066311653120:12345-0@lo:103:ldlm_bl.0 Request processed in 9654us (9919us total) trans 0 rc -107/-107 00000100:00100000:2.0:1782480834.712170:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1782480834.712183:0:3315:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1782480834.712189:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9b6d45cee000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1782480834.712193:0:3315:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.151@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1782480834.722205:0:3315:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.151@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1782480834.722210:0:3315:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1782480834.722231:0:3315:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b6d750f8700 x1869066311652608/t0(0) o400->MGC192.168.204.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1782480848 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480834.722248:0:3315:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b6d473da680 x1869066311653120/t0(0) o103->MGC192.168.204.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782480850 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1782480834.722257:0:3315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1782480834.722259:0:3315:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1782480834.722261:0:3315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1782480834.722264:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9b6d45cee000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782480834.722269:0:3315:0:(import.c:512:import_select_connection()) MGC192.168.204.151@tcp: connect to NID 0@lo last attempt 217 00000100:00080000:3.0:1782480834.722278:0:3315:0:(import.c:626:import_select_connection()) MGC192.168.204.151@tcp: import ffff9b6d45cee000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1782480834.722317:0:3315:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d473da300 x1869066311653248/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782480834.722524:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311652608:0@lo:400:kworker.0 00000100:00100000:3.0:1782480834.722562:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7fffafe6-aedd-4500-93d4-974eea0c11af:3315:1869066311653120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782480834.722714:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7fffafe6-aedd-4500-93d4-974eea0c11af:3314:1869066311653248:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1782480834.722850:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869066311653248 offset 0 length 520: 4 00010000:00010000:0.0:1782480835.255100:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782480835.887230:0:7497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1782480835.887240:0:7497:0:(genops.c:906:class_export_put()) final put ffff9b6c41879800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1782480835.887311:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6c41879800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1782480835.887359:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6c4187c000 for lustre-OST0001 00010000:00010000:1.0:1782480836.279004:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480837.304683:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782480837.366948:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) 7fffafe6-aedd-4500-93d4-974eea0c11af->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1782480837.366959:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) 7fffafe6-aedd-4500-93d4-974eea0c11af->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782480837.367060:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782480837.367292:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311653376:0@lo:400:kworker.0 00000400:00000100:0.0:1782480837.367348:0:3315:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869066311653376 offset 0 length 224: 4 00010000:00010000:0.0:1782480838.326970:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480839.350977:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782480839.416295:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) 7fffafe6-aedd-4500-93d4-974eea0c11af->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782480839.416305:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) 7fffafe6-aedd-4500-93d4-974eea0c11af->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782480839.416378:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782480839.416398:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311653504:0@lo:400:kworker.0 00000400:00000100:0.0:1782480839.416449:0:3318:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869066311653504 offset 0 length 224: 4 00010000:00010000:3.0:1782480840.376040:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480841.400018:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480842.422942:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480843.447530:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480844.023202:0:3314:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782480834/real 1782480834] req@ffff9b6d473da300 x1869066311653248/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782480844 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480844.023234:0:3314:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b6d473da300 x1869066311653248/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1782480844 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480844.023246:0:3314:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782480834/real 1782480834] req@ffff9b6d7f2d4000 x1869066311652992/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782480844 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480844.023301:0:3314:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b6d7f2d4000 x1869066311652992/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782480844 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782480844.023323:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9b6d45cee000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782480844.023351:0:3314:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1782480844.023356:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7fffafe6-aedd-4500-93d4-974eea0c11af:3314:1869066311653248:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1782480844.023364:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9b6d7af53000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1782480844.023384:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1869066311652992:0@lo:39:umount.0 00000100:00080000:0.0:1782480844.023469:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 7fffafe6-aedd-4500-93d4-974eea0c11af->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782480844.023475:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1782480844.023479:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b6d45cee000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782480844.023484:0:8:0:(import.c:512:import_select_connection()) MGC192.168.204.151@tcp: connect to NID 0@lo last attempt 455 00000100:00080000:0.0:1782480844.023488:0:8:0:(import.c:591:import_select_connection()) MGC192.168.204.151@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782480844.023495:0:8:0:(import.c:626:import_select_connection()) MGC192.168.204.151@tcp: import ffff9b6d45cee000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1782480844.023527:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d750fa300 x1869066311653632/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782480844.023622:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311653760:0@lo:400:kworker.0 00000400:00000100:0.0:1782480844.023687:0:3318:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869066311653760 offset 0 length 224: 4 00000100:00080000:3.0:1782480844.023938:0:13035:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782480844.023943:0:13035:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1782480844.023948:0:13035:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1782480844.024846:0:13035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c023a3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a44 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480844.024859:0:13035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c023a3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023a44 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480844.024866:0:13035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c023a3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c023a44 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480844.024872:0:13035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c023a3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c023a44 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480844.024887:0:13035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782480844.024894:0:13035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9c00/0x3dc3ebf33c023c74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023c7b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480844.024913:0:13035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9c00/0x3dc3ebf33c023c74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023c7b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480844.024920:0:13035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9c00/0x3dc3ebf33c023c74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c023c7b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480844.024926:0:13035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9c00/0x3dc3ebf33c023c74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c023c7b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480844.024943:0:13035:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1782480844.024948:0:13035:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1782480844.024969:0:13035:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1782480844.024973:0:13035:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1782480844.024978:0:13035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782480844.024983:0:13035:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1782480844.024988:0:13035:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9b6d47dd3380) has no exports 00000020:00080000:3.0:1782480844.025012:0:13035:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9b6d47dd3380) has no exports 00000020:01000000:3.0:1782480844.026699:0:13035:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b6c42a92720 - data ffff9b6d65ad1360/ffff9b6d75932c00 00000020:01000000:3.0:1782480844.026856:0:13035:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b6d485a0720 - data ffff9b6d65944a20/ffff9b6d7f38b000 00010000:00010000:3.0:1782480844.027168:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782480844.027176:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c023a3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c023a44 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480844.027187:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d82165c00 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:3.0:1782480844.027191:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c023a3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c023a44 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480844.027202:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c023a3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x3dc3ebf33c023a44 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480844.027227:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c023a3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x3dc3ebf33c023a44 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480844.027233:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782480844.027235:0:5795:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1782480844.027238:0:5795:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1782480844.027253:0:5795:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b6d45cee000 00010000:00010000:3.0:1782480844.027257:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c023a3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x3dc3ebf33c023a44 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480844.027264:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c023a3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x3dc3ebf33c023a44 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480844.027548:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7fffafe6-aedd-4500-93d4-974eea0c11af:3314:1869066311653632:0@lo:250:kworker.0 00000400:00000100:1.0:1782480844.027603:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869066311653632 offset 0 length 520: 4 00010000:00010000:0.0:1782480844.027779:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480844.027786:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9c00/0x3dc3ebf33c023c74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c023c7b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480844.027794:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9c00 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:0.0:1782480844.027797:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9c00/0x3dc3ebf33c023c74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c023c7b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480844.027805:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9c00/0x3dc3ebf33c023c74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3dc3ebf33c023c7b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480844.027811:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9c00/0x3dc3ebf33c023c74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3dc3ebf33c023c7b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480844.027815:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1782480844.027818:0:7486:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1782480844.027821:0:7486:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1782480844.027828:0:7486:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b6d45cee000 00010000:00010000:0.0:1782480844.027831:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9c00/0x3dc3ebf33c023c74 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3dc3ebf33c023c7b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480844.027838:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9c00/0x3dc3ebf33c023c74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3dc3ebf33c023c7b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480844.027848:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480844.027849:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480844.027851:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480844.034249:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480844.034259:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480844.034263:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1782480844.042870:0:13035:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1782480844.114220:0:13035:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c02384c 00000020:00000080:3.0:1782480844.114230:0:13035:0:(genops.c:906:class_export_put()) final put ffff9b6d7580c800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1782480844.114245:0:13035:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b6d46055800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1782480844.114248:0:13035:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9b6d46055800 2 00000020:01000004:3.0:1782480844.114252:0:13035:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b6d46055800 from lustre-OST0000 00000020:00000080:3.0:1782480844.114294:0:13035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782480844.114303:0:13035:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1782480844.114306:0:13035:0:(genops.c:906:class_export_put()) final put ffff9b6d7af56000/lustre-OST0000_UUID 00000020:00000080:3.0:1782480844.114309:0:13035:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d7af56000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1782480844.114315:0:13035:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1782480844.114354:0:13035:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1782480844.114359:0:13035:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1782480844.114362:0:13035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782480844.114379:0:13035:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1782480844.114385:0:13035:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9b6d7af52000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782480844.114390:0:13035:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9b6d7f69b380) has exports, disconnecting them 00000020:00080000:3.0:1782480844.114395:0:13035:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9b6d7af52000), last request at 1782480612 00000020:00000080:3.0:1782480844.114399:0:13035:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c023876 00000020:00080000:3.0:1782480844.114408:0:13035:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b6d7af52000): rc 0 00000020:00000080:3.0:1782480844.114412:0:13035:0:(genops.c:906:class_export_put()) final put ffff9b6d7af52000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1782480844.114809:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d7580c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1782480844.114823:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d7af52000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1782480844.118728:0:13035:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1782480844.118737:0:13035:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782480844.118741:0:13035:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1782480844.118768:0:13035:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1782480844.118949:0:13035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782480844.118958:0:13035:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1782480844.118966:0:13035:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9b6d46055800 1 00000020:00000080:0.0:1782480844.118972:0:13035:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c0237f8 00000020:00000080:0.0:1782480844.118979:0:13035:0:(genops.c:906:class_export_put()) final put ffff9b6d7af55000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1782480844.118985:0:13035:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1782480844.118991:0:13035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782480844.118995:0:13035:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1782480844.118998:0:13035:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9b6d6d890000) has no exports 00000020:00000080:1.0:1782480844.119594:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6d7af53000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1782480844.119603:0:8:0:(genops.c:906:class_export_put()) final put ffff9b6d7f623800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1782480844.119605:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d7f623800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1782480844.119619:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1782480844.119673:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d7af55000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1782480844.147802:0:13035:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782480844.147819:0:13035:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1782480844.147825:0:13035:0:(genops.c:906:class_export_put()) final put ffff9b6d46052800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1782480844.147830:0:13035:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d46052800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1782480844.147839:0:13035:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1782480844.147980:0:13035:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9b6d46054800 00000020:02000400:1.0:1782480844.148024:0:13035:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1782480844.472153:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480845.495652:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480846.524534:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782480847.360297:0:13188:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1782480847.377004:0:13188:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1782480847.377257:0:13188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d200/0x3dc3ebf33c023a13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480847.377272:0:13188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d200/0x3dc3ebf33c023a13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023a1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480847.377280:0:13188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d200/0x3dc3ebf33c023a13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c023a1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480847.377286:0:13188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d200/0x3dc3ebf33c023a13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c023a1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480847.377310:0:13188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1782480847.377315:0:13188:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1782480847.377414:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480847.377420:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d200/0x3dc3ebf33c023a13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c023a1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480847.377427:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6873d200 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:3.0:1782480847.377431:0:5796:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d200/0x3dc3ebf33c023a13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c023a1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480847.377439:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d200/0x3dc3ebf33c023a13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3dc3ebf33c023a1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480847.377445:0:5796:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d200/0x3dc3ebf33c023a13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3dc3ebf33c023a1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480847.377451:0:5796:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782480847.377454:0:5796:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1782480847.377457:0:5796:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1782480847.377470:0:5796:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b6d45cee000 00010000:00010000:3.0:1782480847.377474:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d200/0x3dc3ebf33c023a13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3dc3ebf33c023a1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782480847.377477:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782480847.377488:0:13188:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b6d750f8000 x1869066311652864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480848 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1782480847.377490:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d200/0x3dc3ebf33c023a13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3dc3ebf33c023a1a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480847.377502:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480847.377504:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480847.377505:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480847.377570:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311652864:0@lo:400:kworker.0 00000100:00100000:0.0:1782480847.377585:0:13188:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b6d473da680 x1869066311653376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480853 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480847.377605:0:13188:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b6d750f9880 x1869066311653504/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480855 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480847.377623:0:13188:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b6d750f9500 x1869066311653760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480860 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480847.377631:0:13188:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1782480847.377636:0:13188:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1782480847.377663:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311653376:0@lo:400:kworker.0 00000100:00100000:2.0:1782480847.377699:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311653760:0@lo:400:kworker.0 00000100:00080000:0.0:1782480847.377847:0:13188:0:(import.c:65:import_set_state_nolock()) ffff9b6d6f082800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1782480847.378311:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311653504:0@lo:400:kworker.0 00000100:00100000:1.0:1782480847.378482:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1869066311653888:0@lo:39:umount.0 00000400:00000100:1.0:1782480847.378612:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869066311653888 offset 0 length 224: 4 00010000:00010000:1.0:1782480847.543410:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480848.567254:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782480849.142920:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 7fffafe6-aedd-4500-93d4-974eea0c11af->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782480849.142932:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) 7fffafe6-aedd-4500-93d4-974eea0c11af->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1782480849.591651:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480850.617598:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480851.638895:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480852.663117:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480853.687073:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782480854.263498:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 7fffafe6-aedd-4500-93d4-974eea0c11af->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1782480854.263508:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) 7fffafe6-aedd-4500-93d4-974eea0c11af->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1782480854.710904:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480855.734910:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480856.759249:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480857.591158:0:3314:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782480847/real 1782480847] req@ffff9b6d750fb800 x1869066311653888/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782480857 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480857.591196:0:3314:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b6d750fb800 x1869066311653888/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1782480857 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782480857.591215:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9b6d6f082800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1782480857.591247:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1869066311653888:0@lo:39:umount.0 00000100:00080000:0.0:1782480857.591413:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1782480857.591418:0:13188:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1782480857.591424:0:13188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1782480857.593208:0:13188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c023a21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023a28 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480857.593342:0:13188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c023a21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023a28 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480857.593351:0:13188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c023a21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c023a28 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480857.593359:0:13188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c023a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c023a28 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480857.593479:0:13188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782480857.593489:0:13188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8000/0x3dc3ebf33c023c66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c023c6d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480857.593496:0:13188:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8000/0x3dc3ebf33c023c66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c023c6d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480857.593503:0:13188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8000/0x3dc3ebf33c023c66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c023c6d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480857.593509:0:13188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8000/0x3dc3ebf33c023c66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3dc3ebf33c023c6d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480857.595115:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782480857.595129:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c023a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c023a28 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480857.595139:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d413f5200 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:3.0:1782480857.595143:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c023a21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c023a28 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480857.595153:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c023a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3dc3ebf33c023a28 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480857.595159:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c023a21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3dc3ebf33c023a28 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480857.595164:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782480857.595183:0:5795:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1782480857.595196:0:5795:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b6d45cee000 00010000:00010000:3.0:1782480857.595201:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c023a21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3dc3ebf33c023a28 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480857.595208:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5200/0x3dc3ebf33c023a21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3dc3ebf33c023a28 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480857.595229:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480857.595242:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8000/0x3dc3ebf33c023c66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c023c6d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480857.595248:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8000 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:3.0:1782480857.595251:0:5795:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8000/0x3dc3ebf33c023c66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3dc3ebf33c023c6d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480857.595258:0:5795:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8000/0x3dc3ebf33c023c66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3dc3ebf33c023c6d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480857.595265:0:5795:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8000/0x3dc3ebf33c023c66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3dc3ebf33c023c6d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480857.595277:0:5795:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1782480857.595280:0:5795:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1782480857.595284:0:5795:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b6d45cee000 00010000:00010000:3.0:1782480857.595286:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8000/0x3dc3ebf33c023c66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3dc3ebf33c023c6d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480857.595294:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480857.595296:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480857.595298:0:5795:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480857.599594:0:13188:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782480857.599610:0:13188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8000/0x3dc3ebf33c023c66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3dc3ebf33c023c6d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480857.599635:0:13188:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1782480857.599645:0:13188:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1782480857.599647:0:13188:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1782480857.599674:0:13188:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1782480857.599679:0:13188:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1782480857.599689:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782480857.599694:0:13188:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1782480857.599698:0:13188:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9b6d7562cd40) has no exports 00010000:00010000:3.0:1782480857.599792:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1782480857.599913:0:13188:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9b6d7562cd40) has no exports 00000020:01000000:0.0:1782480857.605263:0:13188:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b6c42a92240 - data ffff9b6c415f16c0/ffff9b6d6f07d800 00000020:01000000:0.0:1782480857.607085:0:13188:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b6d464a6120 - data ffff9b6d65b75948/ffff9b6c41d7c400 00100000:10000000:0.0:1782480857.618200:0:13188:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1782480857.678978:0:13188:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c023917 00000020:00000080:1.0:1782480857.678989:0:13188:0:(genops.c:906:class_export_put()) final put ffff9b6d7563d000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1782480857.679005:0:13188:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b6d7581c000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1782480857.679019:0:13188:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9b6d7581c000 2 00000020:01000004:1.0:1782480857.679022:0:13188:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b6d7581c000 from lustre-OST0001 00000020:00000080:1.0:1782480857.679046:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782480857.679056:0:13188:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1782480857.679059:0:13188:0:(genops.c:906:class_export_put()) final put ffff9b6d74c70800/lustre-OST0001_UUID 00000020:00000080:1.0:1782480857.679062:0:13188:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d74c70800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1782480857.679069:0:13188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1782480857.679173:0:13188:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import 7fffafe6-aedd-4500-93d4-974eea0c11af->MGS 00010000:00010000:1.0:1782480857.679189:0:13188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d821ede00/0x3dc3ebf33c023829 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3dc3ebf33c023830 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782480857.679200:0:13188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d821ede00/0x3dc3ebf33c023829 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3dc3ebf33c023830 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480857.679222:0:13188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1782480857.679225:0:13188:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1782480857.679229:0:13188:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1782480857.679243:0:13188:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b6d45cee000 00010000:00010000:1.0:1782480857.679246:0:13188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d821ede00/0x3dc3ebf33c023829 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3dc3ebf33c023830 expref: -99 pid: 6600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480857.679275:0:13188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d600/0x3dc3ebf33c023a67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3dc3ebf33c023a6e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782480857.679283:0:13188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d600/0x3dc3ebf33c023a67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3dc3ebf33c023a6e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480857.679289:0:13188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1782480857.679291:0:13188:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1782480857.679293:0:13188:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1782480857.679303:0:13188:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b6d45cee000 00010000:00010000:1.0:1782480857.679307:0:13188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d6873d600/0x3dc3ebf33c023a67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3dc3ebf33c023a6e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782480857.679322:0:13188:0:(import.c:65:import_set_state_nolock()) ffff9b6d45cee000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1782480857.679325:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1782480857.679328:0:13188:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1782480857.679330:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1782480857.679332:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1782480857.679342:0:13188:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b6d750fa300 x1869066311653632/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1782480859 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1782480857.679361:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1782480857.679363:0:13188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:2.0:1782480857.679503:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7fffafe6-aedd-4500-93d4-974eea0c11af:3314:1869066311653632:0@lo:250:kworker.0 10000000:01000000:1.0:1782480857.679919:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1782480857.679934:0:13188:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c02370a 00000020:00000080:1.0:1782480857.679940:0:13188:0:(genops.c:906:class_export_put()) final put ffff9b6d465b6000/7fffafe6-aedd-4500-93d4-974eea0c11af 00000020:01000000:1.0:1782480857.679948:0:13188:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.204.151@tcp (flags='') 00000020:00000080:1.0:1782480857.679952:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782480857.679958:0:13188:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.151@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1782480857.679961:0:13188:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9b6d4845cd40) has no exports 10000000:01000000:2.0:1782480857.680026:0:5804:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:3.0:1782480857.680070:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d7563d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1782480857.680079:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d465b6000/7fffafe6-aedd-4500-93d4-974eea0c11af for MGC192.168.204.151@tcp 10000000:01000000:1.0:1782480857.680107:0:13188:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.151@tcp: client import never connected 00000100:00080000:1.0:1782480857.680110:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1782480857.680112:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1782480857.680115:0:13188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1782480857.680116:0:13188:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1782480857.680153:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782480857.680157:0:13188:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.151@tcp (uuid 7fffafe6-aedd-4500-93d4-974eea0c11af) 00000020:01000000:1.0:1782480857.680161:0:13188:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1782480857.680164:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782480857.680167:0:13188:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1782480857.680171:0:13188:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9b6d7f11d800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1782480857.680176:0:13188:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9b6d6d8919c0) has exports, disconnecting them 00000020:00080000:1.0:1782480857.680180:0:13188:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9b6d7f11d800), last request at 1782480633 00000020:00000080:1.0:1782480857.680183:0:13188:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c023941 00000020:00080000:1.0:1782480857.680192:0:13188:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b6d7f11d800): rc 0 00000020:00000080:1.0:1782480857.680196:0:13188:0:(genops.c:906:class_export_put()) final put ffff9b6d7f11d800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1782480857.680337:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6d45cee000 for MGC192.168.204.151@tcp 00000020:00000080:3.0:1782480857.680343:0:38:0:(genops.c:906:class_export_put()) final put ffff9b6d45ced000/7fffafe6-aedd-4500-93d4-974eea0c11af 00000020:00000080:3.0:1782480857.680346:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d45ced000/7fffafe6-aedd-4500-93d4-974eea0c11af for MGC192.168.204.151@tcp 00000020:01000000:3.0:1782480857.680351:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.151@tcp (7fffafe6-aedd-4500-93d4-974eea0c11af) 00000020:00000080:3.0:1782480857.680564:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d7f11d800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1782480857.733220:0:13188:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1782480857.733231:0:13188:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782480857.733236:0:13188:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1782480857.733243:0:13188:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1782480857.733481:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1782480857.733651:0:5795:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1782480857.733715:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000020:00000080:2.0:1782480857.734285:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b6d6f082800 for lustre-MDT0000-lwp-OST0001 00000100:00100000:0.0:1782480857.735990:0:5791:0:(service.c:3182:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9b6d44a9fe00:5791] 1 exiting: rc = 0 00000100:00100000:2.0:1782480857.744736:0:8303:0:(service.c:3182:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9b6d7f2b7600:8303] 2 exiting: rc = 0 00000100:00100000:3.0:1782480857.745689:0:5790:0:(service.c:3182:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9b6d80898400:5790] 0 exiting: rc = 1 00000100:00100000:3.0:1782480857.745786:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.748505:0:5794:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9b6d44a9e000:5794] 2 exiting: rc = 0 00000100:00100000:3.0:1782480857.748631:0:8304:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9b6d757da400:8304] 3 exiting: rc = 0 00000100:00100000:2.0:1782480857.748636:0:5793:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9b6d44a9fa00:5793] 1 exiting: rc = 0 00000100:00100000:0.0:1782480857.754851:0:5792:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9b6d44a9fc00:5792] 0 exiting: rc = 1 00000100:00100000:3.0:1782480857.755285:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755294:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755300:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755305:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755310:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755326:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755332:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755337:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755343:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755349:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755354:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755360:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755379:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755384:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755390:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755395:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755400:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755406:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755410:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755416:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755421:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755426:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755430:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755435:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755440:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755446:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755452:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755457:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755462:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755466:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755471:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755475:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755480:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755486:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755491:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755495:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755500:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755504:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755509:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755514:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755519:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755524:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755530:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755534:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755538:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755543:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755548:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755559:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755563:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755568:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755572:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755576:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755580:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755585:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755590:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755595:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755599:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755603:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755608:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755613:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755618:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755623:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755627:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.755633:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1782480857.756677:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782480857.756688:0:13188:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1782480857.756694:0:13188:0:(genops.c:906:class_export_put()) final put ffff9b6d7f11b800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1782480857.756699:0:13188:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d7f11b800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1782480857.756710:0:13188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1782480857.756775:0:13188:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9b6d7581c000 1 00000020:00000080:3.0:1782480857.756781:0:13188:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3dc3ebf33c0238e6 00000020:00000080:3.0:1782480857.756787:0:13188:0:(genops.c:906:class_export_put()) final put ffff9b6d7581f800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1782480857.756812:0:13188:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1782480857.756817:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782480857.756822:0:13188:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782480857.756826:0:13188:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9b6d460bcd40) has no exports 00000020:00000080:2.0:1782480857.756854:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d7581f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1782480857.785673:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782480857.785689:0:13188:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1782480857.785695:0:13188:0:(genops.c:906:class_export_put()) final put ffff9b6d7581d000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1782480857.785700:0:13188:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d7581d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1782480857.785710:0:13188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1782480857.785959:0:13188:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9b6d7581e800 00000020:01000000:2.0:1782480857.785982:0:13188:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1782480857.785986:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782480857.785990:0:13188:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1782480857.785995:0:13188:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9b6d47dd4d40) has no exports 00000020:00000080:2.0:1782480857.786031:0:13188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782480857.786047:0:13188:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1782480857.786051:0:13188:0:(genops.c:906:class_export_put()) final put ffff9b6d7af50800/OSS_uuid 00000020:00000080:2.0:1782480857.786053:0:13188:0:(genops.c:865:class_export_destroy()) destroying export ffff9b6d7af50800/OSS_uuid for OSS 00000020:01000000:2.0:1782480857.786056:0:13188:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1782480857.786083:0:5803:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1782480857.786506:0:6604:0:(service.c:3182:ptlrpc_main()) ll_ost00_001: service thread [ffff9b6d76271000:6604] 1 exiting: rc = 0 00000100:00100000:1.0:1782480857.787847:0:6605:0:(service.c:3182:ptlrpc_main()) ll_ost00_002: service thread [ffff9b6d45e20e00:6605] 2 exiting: rc = 0 00000100:00100000:1.0:1782480857.788438:0:6602:0:(service.c:3182:ptlrpc_main()) ll_ost00_000: service thread [ffff9b6d47217000:6602] 0 exiting: rc = 1 00000100:00100000:1.0:1782480857.788488:0:8678:0:(service.c:3182:ptlrpc_main()) ll_ost00_003: service thread [ffff9b6d6d82fe00:8678] 3 exiting: rc = 0 00000100:00100000:3.0:1782480857.796123:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796134:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796152:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796163:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796169:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796401:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796407:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796414:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796419:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796423:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796428:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796616:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796628:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796633:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796638:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796643:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796648:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796653:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796690:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796699:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796706:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796714:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796723:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796728:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796733:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796743:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796748:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796773:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796779:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796785:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796801:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796808:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796817:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796822:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796827:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796833:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796837:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796842:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796852:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796858:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796872:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796877:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796882:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796886:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796890:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796895:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796900:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796918:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796923:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796929:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796935:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796940:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796945:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796950:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796955:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796961:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796966:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796972:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796988:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796993:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.796998:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.797012:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.797019:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.797025:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.798558:0:6606:0:(service.c:3182:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9b6d7519d200:6606] 0 exiting: rc = 1 00000100:00100000:3.0:1782480857.798837:0:6607:0:(service.c:3182:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9b6d47cf5200:6607] 1 exiting: rc = 0 00000100:00100000:3.0:1782480857.798888:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.798896:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.798901:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.798906:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.798910:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.798915:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.798920:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.798925:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.798929:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.798934:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.798951:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.798956:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.798961:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.798981:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.798986:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.798992:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.798997:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799002:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799020:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799027:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799032:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799037:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799041:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799046:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799051:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799056:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799061:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799066:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799071:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799076:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799080:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799085:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799090:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799095:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799100:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799105:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799109:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799114:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799120:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799124:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799129:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799135:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799139:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799144:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799149:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799162:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799168:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799175:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799180:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799184:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799189:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799194:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799198:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799203:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799207:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799213:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799218:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799223:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799228:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799233:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799238:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799242:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799247:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.799259:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.804500:0:6608:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9b6d47217c00:6608] 0 exiting: rc = 1 00000100:00100000:3.0:1782480857.804720:0:6610:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9b6d45dfd600:6610] 2 exiting: rc = 0 00000100:00100000:3.0:1782480857.804905:0:12383:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9b6c41903c00:12383] 3 exiting: rc = 0 00000100:00100000:1.0:1782480857.805045:0:6609:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9b6d76271800:6609] 1 exiting: rc = 0 00000100:00100000:2.0:1782480857.805154:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805163:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805170:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805177:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805183:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805189:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805195:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805201:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805206:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805211:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805225:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805233:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805238:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805245:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805251:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805257:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805899:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805914:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805920:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805926:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805932:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805937:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805941:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805947:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805952:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805957:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805962:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805968:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805985:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.805994:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806000:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806017:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806022:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806027:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806048:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806054:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806062:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806069:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806080:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806090:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806100:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806105:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806110:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806116:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806122:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806127:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806132:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806137:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806143:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806147:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806153:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806158:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806163:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806168:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806173:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806179:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806185:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806192:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806494:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806505:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806513:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806534:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806544:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.806565:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480857.817303:0:6612:0:(service.c:3182:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9b6d45dfde00:6612] 1 exiting: rc = 0 00000100:00100000:3.0:1782480857.817492:0:6611:0:(service.c:3182:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9b6d47217a00:6611] 0 exiting: rc = 1 00000100:00100000:2.0:1782480857.817697:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817714:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817721:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817726:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817737:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817743:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817769:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817776:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817782:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817788:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817793:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817883:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817890:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817895:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817900:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817905:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817909:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817921:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817926:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817934:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817939:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817945:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817952:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817959:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817966:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817977:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817984:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817989:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.817994:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818000:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818016:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818027:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818034:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818039:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818059:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818066:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818074:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818081:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818091:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818098:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818118:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818130:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818136:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818141:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818147:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818152:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818158:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818166:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818172:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818179:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818189:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818194:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818199:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818205:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818209:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818215:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818221:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818233:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818239:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818244:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818250:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818255:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818261:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.818954:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480857.820297:0:6613:0:(service.c:3182:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9b6d75817600:6613] 0 exiting: rc = 1 00000100:00100000:0.0:1782480857.821658:0:6614:0:(service.c:3182:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9b6d75817a00:6614] 1 exiting: rc = 0 00000100:00100000:2.0:1782480857.822473:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822485:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822495:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822502:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822513:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822550:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822557:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822564:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822572:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822579:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822586:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822593:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822600:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822605:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822613:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822620:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822626:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822648:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822654:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822661:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822668:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822676:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822682:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822689:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822695:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822703:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822710:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822716:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822723:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822764:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822773:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822780:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.822788:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824071:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824087:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824093:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824099:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824105:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824112:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824117:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824137:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824164:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824171:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824180:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824188:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824194:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824200:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824206:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824212:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824219:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824226:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824232:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824239:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824259:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824265:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824285:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824292:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824297:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824302:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824309:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824315:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824320:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824326:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480857.824332:0:13188:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1782480857.855336:0:13188:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1782480874.796368:0:13807:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1782480881.906265:0:14220:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1782480881.906269:0:14220:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1782480881.906377:0:14220:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b6d52754000 00000020:01000004:0.0:1782480881.906392:0:14220:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1782480881.906400:0:14220:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1782480881.906414:0:14220:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9b6d460bb380) 00000020:00000080:0.0:1782480881.906430:0:14220:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1782480881.928016:0:14220:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1782480881.929805:0:14220:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1782480881.930145:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 87: rc = 0 00100000:10000000:3.0:1782480881.930245:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 87: rc = 0 00100000:10000000:3.0:1782480881.930343:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 87: rc = 0 00100000:10000000:3.0:1782480881.930436:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 87: rc = 0 00100000:10000000:3.0:1782480881.931111:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 87: rc = 0 00100000:10000000:3.0:1782480881.931354:0:14220:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1782480881.931438:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 87: rc = 0 00100000:10000000:3.0:1782480881.931687:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 370: rc = 0 00100000:10000000:3.0:1782480881.933051:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 405: rc = 0 00100000:10000000:3.0:1782480881.933152:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 405: rc = 0 00100000:10000000:3.0:1782480881.933660:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 411: rc = 0 00100000:10000000:3.0:1782480881.934377:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 411: rc = 0 00100000:10000000:3.0:1782480881.934729:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 411: rc = 0 00100000:10000000:3.0:1782480881.937120:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 411: rc = 0 00100000:10000000:3.0:1782480881.937424:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 411: rc = 0 00100000:10000000:3.0:1782480881.937677:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 411: rc = 0 00100000:10000000:3.0:1782480881.937948:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 411: rc = 0 00100000:10000000:3.0:1782480881.938183:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 411: rc = 0 00100000:10000000:3.0:1782480881.938412:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 411: rc = 0 00100000:10000000:3.0:1782480881.938666:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 411: rc = 0 00100000:10000000:3.0:1782480881.938939:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 411: rc = 0 00100000:10000000:3.0:1782480881.939199:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 411: rc = 0 00100000:10000000:3.0:1782480881.939631:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 433: rc = 0 00100000:10000000:3.0:1782480881.939908:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 433: rc = 0 00100000:10000000:3.0:1782480881.940162:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 433: rc = 0 00100000:10000000:3.0:1782480881.940387:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 433: rc = 0 00100000:10000000:3.0:1782480881.942179:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 433: rc = 0 00100000:10000000:3.0:1782480881.942545:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 433: rc = 0 00100000:10000000:3.0:1782480881.943055:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 433: rc = 0 00100000:10000000:3.0:1782480881.943304:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 433: rc = 0 00100000:10000000:3.0:1782480881.945070:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 433: rc = 0 00100000:10000000:3.0:1782480881.945350:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 433: rc = 0 00100000:10000000:3.0:1782480881.945999:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 433: rc = 0 00100000:10000000:3.0:1782480881.946246:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 433: rc = 0 00100000:10000000:3.0:1782480881.947353:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 433: rc = 0 00100000:10000000:3.0:1782480881.947913:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 433: rc = 0 00100000:10000000:3.0:1782480881.948247:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 433: rc = 0 00100000:10000000:3.0:1782480881.948585:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 433: rc = 0 00100000:10000000:3.0:1782480881.949012:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 433: rc = 0 00100000:10000000:3.0:1782480881.953348:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 433: rc = 0 00100000:10000000:3.0:1782480881.954219:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 433: rc = 0 00100000:10000000:3.0:1782480881.954571:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 433: rc = 0 00100000:10000000:3.0:1782480881.955332:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 433: rc = 0 00100000:10000000:3.0:1782480881.956155:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 433: rc = 0 00100000:10000000:3.0:1782480881.956504:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 433: rc = 0 00100000:10000000:3.0:1782480881.956986:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 433: rc = 0 00100000:10000000:3.0:1782480881.957516:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 433: rc = 0 00100000:10000000:3.0:1782480881.957928:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 433: rc = 0 00100000:10000000:3.0:1782480881.958261:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 433: rc = 0 00100000:10000000:3.0:1782480881.958600:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 433: rc = 0 00100000:10000000:3.0:1782480881.958982:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 433: rc = 0 00100000:10000000:3.0:1782480881.959286:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 433: rc = 0 00100000:10000000:3.0:1782480881.959650:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 433: rc = 0 00100000:10000000:3.0:1782480881.960124:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 433: rc = 0 00100000:10000000:3.0:1782480881.960522:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 628: rc = 0 00100000:10000000:2.0:1782480881.969081:0:14220:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1782480881.969314:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 406: rc = 0 00100000:10000000:2.0:1782480881.970510:0:14220:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1782480881.970606:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 406: rc = 0 00100000:10000000:2.0:1782480881.970883:0:14220:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1782480881.970955:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 406: rc = 0 00100000:10000000:2.0:1782480881.971326:0:14220:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1782480881.971397:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 408: rc = 0 00100000:10000000:2.0:1782480881.971606:0:14220:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1782480881.971678:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 408: rc = 0 00100000:10000000:2.0:1782480881.971909:0:14220:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1782480881.971990:0:14220:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 408: rc = 0 00000020:00000080:2.0:1782480881.972272:0:14220:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1782480881.972282:0:14220:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782480881.972294:0:14220:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3dc3ebf33c024a0b 00000020:01000004:2.0:1782480881.972304:0:14220:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1782480881.972309:0:14220:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1782480881.972314:0:14220:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b6d52754000 from MGS 00000020:01000004:2.0:1782480881.972317:0:14220:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1782480881.972327:0:14220:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9b6d7f6999c0) 00000020:00000080:2.0:1782480881.972337:0:14220:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1782480881.972396:0:14220:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6d52754000 from MGS, refs=2 00080000:01000000:2.0:1782480881.972402:0:14220:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782480881.972408:0:14220:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3dc3ebf33c024a19 00000100:00100000:2.0:1782480881.972508:0:14220:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1782480881.973350:0:14220:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1782480881.973357:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1782480881.974174:0:14220:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1782480881.974182:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1782480881.975996:0:14220:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782480881.976240:0:14220:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1782480881.976246:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1782480881.989300:0:14220:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1782480881.989315:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1782480881.990231:0:14220:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1782480881.990240:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1782480881.991308:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480881.991312:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480881.991314:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480881.991626:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480881.991628:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480881.991630:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480881.992310:0:14220:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1782480881.994897:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1782480882.005385:0:14220:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1782480882.005403:0:14220:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1782480882.005405:0:14220:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1782480882.007193:0:14229:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1782480882.007443:0:14220:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1782480882.007571:0:14220:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1782480882.011979:0:14220:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1782480882.012246:0:14220:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782480882.012388:0:14220:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1782480882.012393:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1782480882.013354:0:14220:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1782480882.013362:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1782480882.013873:0:14220:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1782480882.013880:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1782480882.014542:0:14220:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1782480882.014571:0:14220:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.204.151@tcp' 00000020:01000004:1.0:1782480882.014573:0:14220:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1782480882.014864:0:14220:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.204.151@tcp (typ=mgc) 00000020:00000080:1.0:1782480882.014877:0:14220:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.151@tcp (ffff9b6d7562cd40) 00000020:00000080:1.0:1782480882.014891:0:14220:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1782480882.015215:0:14220:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6d46056000@MGC192.168.204.151@tcp: add connection 192.168.204.151@tcp at head 00010000:00010000:1.0:1782480882.015475:0:14220:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.151@tcp-0 is initialized 00000040:01000000:1.0:1782480882.015482:0:14220:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 1 is initialized 00000100:00080000:3.0:1782480882.015651:0:14234:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1782480882.016972:0:14235:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1782480882.017008:0:14220:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.151@tcp (uuid ed2e1d0c-2f63-46f9-ac79-60f348db465e) 00000020:00000080:1.0:1782480882.017027:0:14220:0:(genops.c:1406:class_connect()) connect: client ed2e1d0c-2f63-46f9-ac79-60f348db465e, cookie 0x3dc3ebf33c024a27 00000100:00080000:1.0:1782480882.017038:0:14220:0:(import.c:512:import_select_connection()) MGC192.168.204.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782480882.017044:0:14220:0:(import.c:626:import_select_connection()) MGC192.168.204.151@tcp: import ffff9b6d46056000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1782480882.017079:0:14220:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d75579500 x1869066311654016/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782480882.017143:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3314:1869066311654016:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1782480882.017205:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782480882.017263:0:14220:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import ed2e1d0c-2f63-46f9-ac79-60f348db465e->MGS 00000020:01000004:1.0:1782480882.017282:0:14220:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1782480882.017286:0:14220:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1782480882.017298:0:14220:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9b6d75628000) 00000020:00000080:1.0:1782480882.017308:0:14220:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1782480882.024983:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311654016 00000100:00100000:2.0:1782480882.025000:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311654016 00000100:00100000:2.0:1782480882.025046:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782480882.025056:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3314:x1869066311654016:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1782480882.025083:0:14231:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from ed2e1d0c-2f63-46f9-ac79-60f348db465e@0@lo t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:2.0:1782480882.025114:0:14231:0:(genops.c:1406:class_connect()) connect: client ed2e1d0c-2f63-46f9-ac79-60f348db465e, cookie 0x3dc3ebf33c024a35 00000100:00080000:2.0:1782480882.025242:0:14231:0:(import.c:65:import_set_state_nolock()) ffff9b6d7b291800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782480882.025692:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+5:3314:x1869066311654016:12345-0@lo:250:mount.lustre.0 Request processed in 635us (8485us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480882.025701:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782480882.028484:0:14220:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782480882.029046:0:3314:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.204.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1782480882.029058:0:3314:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.204.151@tcp: connect to target with instance 0 00000100:00080000:3.0:1782480882.029068:0:3314:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.204.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1782480882.029073:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1782480882.029077:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9b6d46056000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1782480882.029081:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1782480882.029085:0:3314:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1782480882.029095:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3314:1869066311654016:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1782480882.029295:0:14220:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1782480882.029308:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1782480882.030225:0:14220:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1782480882.030232:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1782480882.030712:0:14220:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1782480882.030719:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1782480882.032438:0:14220:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782480882.032586:0:14220:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1782480882.032591:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1782480882.033260:0:14220:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1782480882.033268:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1782480882.067211:0:14220:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782480882.067537:0:14220:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1782480882.067546:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1782480882.069476:0:14220:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1782480882.069491:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1782480882.070653:0:14220:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782480882.070978:0:14220:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782480882.070985:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1782480882.071584:0:14220:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782480882.071591:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1782480882.072407:0:14220:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782480882.072555:0:14220:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782480882.072560:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1782480882.073424:0:14220:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782480882.073432:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1782480882.074113:0:14220:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782480882.074332:0:14220:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782480882.074339:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1782480882.074980:0:14220:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782480882.074987:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1782480882.090159:0:14220:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782480882.091467:0:14220:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1782480882.091476:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1782480882.092650:0:14220:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1782480882.092662:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1782480882.094032:0:14220:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1782480882.094043:0:14220:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1782480882.095067:0:14220:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1782480882.095090:0:14220:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1782480882.095097:0:14220:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1782480882.095230:0:14220:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782480882.095380:0:14220:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.151@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1782480882.095385:0:14220:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782480882.095387:0:14220:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782480882.095388:0:14220:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480882.095389:0:14220:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782480882.095391:0:14220:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480882.095392:0:14220:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480882.095394:0:14220:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782480882.095395:0:14220:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782480882.095397:0:14220:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480882.095398:0:14220:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782480882.095401:0:14220:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1782480882.095403:0:14220:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782480882.095404:0:14220:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782480882.095405:0:14220:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480882.095406:0:14220:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782480882.095407:0:14220:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480882.095408:0:14220:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480882.095413:0:14220:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782480882.095414:0:14220:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782480882.095415:0:14220:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480882.095416:0:14220:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782480882.095441:0:14220:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1782480882.095460:0:14220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311654144:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782480882.095547:0:14220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480882.095637:0:14220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f250c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480882.096090:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311654144 00000100:00100000:3.0:1782480882.096098:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311654144 00000100:00100000:3.0:1782480882.096182:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782480882.096190:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+5:14220:x1869066311654144:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1782480882.096236:0:14233:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1782480882.096239:0:14233:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1782480882.096243:0:14233:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1782480882.096588:0:14254:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1782480882.096985:0:14233:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1782480882.098078:0:14255:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1782480882.098084:0:14255:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1782480882.098086:0:14255:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1782480882.098123:0:14255:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1782480882.098460:0:14233:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1782480882.098470:0:14233:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1782480882.105590:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+5:14220:x1869066311654144:12345-0@lo:253:mount.lustre.0 Request processed in 9391us (10035us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480882.105609:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782480882.105704:0:14220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311654144:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782480882.105718:0:14220:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1782480882.105721:0:14220:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782480882.105723:0:14220:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782480882.105724:0:14220:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480882.105726:0:14220:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782480882.105727:0:14220:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480882.105728:0:14220:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480882.105729:0:14220:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782480882.105730:0:14220:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782480882.105732:0:14220:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480882.105733:0:14220:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782480882.106107:0:14220:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b6d52754000 from lustre-MDT0000 10000000:01000000:3.0:1782480882.106132:0:14220:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1782480882.106147:0:14220:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1782480882.106151:0:14220:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b6d7562cd40 10000000:01000000:3.0:1782480882.106155:0:14220:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782480882.106163:0:14220:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9b6d7562cd40 from 1 10000000:01000000:3.0:1782480882.106166:0:14220:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782480882.106199:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c024a3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.106211:0:14220:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c024a3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.106220:0:14220:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c024a3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480882.106238:0:14220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311654272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782480882.106364:0:14220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480882.106437:0:14220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51ed79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480882.106542:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311654272 00000100:00100000:2.0:1782480882.106548:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311654272 00000100:00100000:2.0:1782480882.106616:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782480882.106625:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+5:14220:x1869066311654272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782480882.106644:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480882.106657:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d582e8e00/0x3dc3ebf33c024a43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c024a3c expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480882.106678:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d582e8e00/0x3dc3ebf33c024a43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c024a3c expref: 6 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480882.106687:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d582e8e00/0x3dc3ebf33c024a43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024a3c expref: 6 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480882.106695:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e8e00, rc 0) 00000100:00100000:2.0:1782480882.106732:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+6:14220:x1869066311654272:12345-0@lo:101:mount.lustre.0 Request processed in 108us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480882.106738:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782480882.106845:0:14220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311654272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782480882.106859:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c024a3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024a43 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.106867:0:14220:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c024a3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c024a43 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480882.106915:0:14220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311654400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782480882.106938:0:14220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480882.107174:0:14220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51ed79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480882.107338:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311654400 00000100:00100000:0.0:1782480882.107343:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311654400 00000100:00100000:0.0:1782480882.107373:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782480882.107380:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+6:14220:x1869066311654400:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782480882.107597:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+6:14220:x1869066311654400:12345-0@lo:501:mount.lustre.0 Request processed in 217us (657us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782480882.107604:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782480882.107674:0:14220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311654400:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1782480882.107697:0:14220:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782480882.107723:0:14220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c024a3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024a43 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.107731:0:14220:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c024a3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024a43 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480882.107738:0:14220:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b6d52754000 10000000:01000000:3.0:1782480882.107742:0:14220:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782480882.107770:0:14220:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b6d52754000 10000000:01000000:3.0:1782480882.107774:0:14220:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1782480882.107777:0:14220:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9b6d52754000 from 1 10000000:01000000:3.0:1782480882.107779:0:14220:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1782480882.107809:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82164000/0x3dc3ebf33c024a4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.107817:0:14220:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d82164000/0x3dc3ebf33c024a4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.107825:0:14220:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d82164000/0x3dc3ebf33c024a4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480882.107841:0:14220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311654528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782480882.107865:0:14220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480882.107881:0:14220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51ed79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480882.108028:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311654528 00000100:00100000:0.0:1782480882.108037:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311654528 00000100:00100000:0.0:1782480882.108054:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782480882.108060:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+6:14220:x1869066311654528:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782480882.108068:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480882.108081:0:14232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d45d2c000/0x3dc3ebf33c024a51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c024a4a expref: -99 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.108098:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d45d2c000/0x3dc3ebf33c024a51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c024a4a expref: 7 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.108106:0:14232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d45d2c000/0x3dc3ebf33c024a51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024a4a expref: 7 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.108113:0:14232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2c000, rc 0) 00000100:00100000:0.0:1782480882.108151:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+7:14220:x1869066311654528:12345-0@lo:101:mount.lustre.0 Request processed in 90us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480882.108157:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782480882.108224:0:14220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311654528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782480882.108235:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d82164000/0x3dc3ebf33c024a4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024a51 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.108242:0:14220:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d82164000/0x3dc3ebf33c024a4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c024a51 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480882.108274:0:14220:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1782480882.108287:0:14220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82164000/0x3dc3ebf33c024a4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024a51 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.108293:0:14220:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d82164000/0x3dc3ebf33c024a4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024a51 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480882.108299:0:14220:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1782480882.108302:0:14220:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782480882.108306:0:14220:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b6d52754000 10000000:01000000:3.0:1782480882.108309:0:14220:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1782480882.108311:0:14220:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1782480882.108313:0:14220:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782480882.108328:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82165200/0x3dc3ebf33c024a58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.108334:0:14220:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d82165200/0x3dc3ebf33c024a58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.108341:0:14220:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d82165200/0x3dc3ebf33c024a58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480882.108353:0:14220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311654656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782480882.108378:0:14220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480882.108389:0:14220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51ed79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480882.108502:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311654656 00000100:00100000:0.0:1782480882.108506:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311654656 00000100:00100000:0.0:1782480882.108525:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782480882.108542:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+7:14220:x1869066311654656:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782480882.108549:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480882.108557:0:14232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d45d2c200/0x3dc3ebf33c024a5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c024a58 expref: -99 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.108570:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d45d2c200/0x3dc3ebf33c024a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c024a58 expref: 8 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.108578:0:14232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d45d2c200/0x3dc3ebf33c024a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024a58 expref: 8 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.108594:0:14232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2c200, rc 0) 00000100:00100000:0.0:1782480882.108631:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+8:14220:x1869066311654656:12345-0@lo:101:mount.lustre.0 Request processed in 90us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480882.108636:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782480882.109028:0:14220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311654656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782480882.109040:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d82165200/0x3dc3ebf33c024a58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024a5f expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.109055:0:14220:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d82165200/0x3dc3ebf33c024a58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c024a5f expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480882.109106:0:14220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311654784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782480882.109133:0:14220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480882.109151:0:14220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51ed79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480882.109199:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311654784 00000100:00100000:0.0:1782480882.109203:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311654784 00000100:00100000:0.0:1782480882.109236:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782480882.109253:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+8:14220:x1869066311654784:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782480882.109607:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+9:14220:x1869066311654784:12345-0@lo:501:mount.lustre.0 Request processed in 363us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480882.109614:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782480882.109781:0:14220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311654784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782480882.109824:0:14220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311654912:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782480882.109861:0:14220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480882.109878:0:14220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51ed79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480882.110055:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311654912 00000100:00100000:2.0:1782480882.110060:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311654912 00000100:00100000:2.0:1782480882.110084:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782480882.110090:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+9:14220:x1869066311654912:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782480882.110463:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+9:14220:x1869066311654912:12345-0@lo:503:mount.lustre.0 Request processed in 372us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480882.110469:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782480882.110554:0:14220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311654912:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782480882.111172:0:14256:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14256:1869066311655040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480882.111217:0:14256:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480882.111324:0:14256:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51ed7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782480882.111369:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311655040 00000100:00100000:2.0:1782480882.111374:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311655040 00000100:00100000:2.0:1782480882.111448:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782480882.111457:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+9:14256:x1869066311655040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480882.111737:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+9:14256:x1869066311655040:12345-0@lo:502:llog_process_th.0 Request processed in 281us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480882.111775:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782480882.111930:0:14256:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14256:1869066311655040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782480882.111953:0:14256:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782480882.111963:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480882.111965:0:14256:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1782480882.111971:0:14256:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1782480882.111974:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782480882.111987:0:14256:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9b6d6d8919c0) 00000020:00000080:3.0:1782480882.112004:0:14256:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1782480882.112011:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1782480882.112071:0:14256:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1782480882.112077:0:14256:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3dc3ebf33c024a6d 00000020:00000080:3.0:1782480882.112302:0:14256:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1782480882.112307:0:14256:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782480882.112310:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480882.112312:0:14256:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1782480882.112314:0:14256:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782480882.112318:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480882.112320:0:14256:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1782480882.112323:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782480882.112331:0:14256:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9b6d6d894d40) 00000020:00000080:3.0:1782480882.112339:0:14256:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1782480882.112343:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1782480882.112345:0:14256:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1782480882.112348:0:14256:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1782480882.112354:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782480882.112394:0:14256:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6d52754000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1782480882.112406:0:14256:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9b6d6d890000) 00000020:00000080:3.0:1782480882.112413:0:14256:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1782480882.112468:0:14256:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1782480882.112474:0:14256:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3dc3ebf33c024a82 00000020:00000080:3.0:1782480882.112573:0:14256:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1782480882.112580:0:14256:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1782480882.112584:0:14256:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3dc3ebf33c024a89 00080000:01000000:3.0:1782480882.112588:0:14256:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1782480882.112591:0:14256:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3dc3ebf33c024a90 00010000:00010000:2.0:1782480882.162591:0:14256:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1782480882.163236:0:14256:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1782480882.163423:0:14256:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1782480882.164248:0:14256:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9b6d7f69cd40) 00000020:00000080:2.0:1782480882.164267:0:14256:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1782480882.164329:0:14256:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1782480882.164336:0:14256:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3dc3ebf33c024a9e 00000020:00000080:3.0:1782480882.169089:0:14256:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1782480882.176273:0:14256:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3dc3ebf33c024aa5 00000020:00000080:2.0:1782480882.176716:0:14256:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1782480882.176728:0:14256:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480882.176734:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480882.176735:0:14256:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1782480882.176742:0:14256:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782480882.176775:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480882.176777:0:14256:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1782480882.176782:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1782480882.176819:0:14256:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1782480882.176833:0:14256:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480882.176836:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480882.176838:0:14256:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1782480882.176840:0:14256:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1782480882.176842:0:14256:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #10 00000020:01000000:2.0:1782480882.176844:0:14256:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782480882.176846:0:14256:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782480882.176847:0:14256:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1782480882.176850:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480882.176851:0:14256:0:(obd_config.c:1561:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:2.0:1782480882.176853:0:14256:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782480882.176856:0:14256:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1782480882.176859:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480882.176860:0:14256:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1782480882.176870:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782480882.176876:0:14256:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:2.0:1782480882.176898:0:14256:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1782480882.176900:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782480882.177149:0:14256:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b6d7f69b380) 00000020:00000080:2.0:1782480882.177164:0:14256:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1782480882.177171:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782480882.177235:0:14256:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1782480882.177241:0:14256:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1782480882.177247:0:14256:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3dc3ebf33c024ab3 00010000:00080000:2.0:1782480882.177277:0:14256:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6d43583800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:2.0:1782480882.177540:0:14256:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1782480882.178190:0:14256:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1782480882.178236:0:14256:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1782480882.179362:0:14256:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782480882.179430:0:14256:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1782480882.179511:0:14256:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1782480882.180191:0:14260:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1782480882.180196:0:14260:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1782480882.181051:0:14256:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782480882.181064:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1782480882.181096:0:14256:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1782480882.181114:0:14256:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3dc3ebf33c024aba 00000100:00080000:2.0:1782480882.181125:0:14256:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782480882.181131:0:14256:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b6d43583800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1782480882.181170:0:14256:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d7f2d4a80 x1869066311655168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782480882.181235:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1869066311655168:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1782480882.181287:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869066311655168 offset 0 length 520: 4 00000100:00080000:2.0:1782480882.181345:0:14256:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1782480882.181401:0:14256:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480882.181405:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480882.181407:0:14256:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1782480882.181410:0:14256:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1782480882.181423:0:14256:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1782480882.181424:0:14256:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782480882.181426:0:14256:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782480882.181428:0:14256:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1782480882.181430:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480882.181432:0:14256:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1782480882.181434:0:14256:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782480882.181438:0:14256:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1782480882.181442:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480882.181443:0:14256:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1782480882.181446:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1782480882.181449:0:14256:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:2.0:1782480882.181468:0:14256:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1782480882.181471:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782480882.181482:0:14256:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b6d7f698000) 00000020:00000080:2.0:1782480882.181493:0:14256:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1782480882.181498:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1782480882.181571:0:14256:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1782480882.181576:0:14256:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1782480882.181582:0:14256:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3dc3ebf33c024ac8 00010000:00080000:2.0:1782480882.181623:0:14256:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6d4358e800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:2.0:1782480882.181836:0:14256:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1782480882.182085:0:14256:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1782480882.182105:0:14256:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1782480882.182598:0:14256:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782480882.182666:0:14256:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1782480882.182776:0:14256:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:1.0:1782480882.182983:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782480882.182996:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7557ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3316:1869066311655296:0@lo:400:kworker.0 00000100:00100000:1.0:1782480882.183052:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480882.183603:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311655296 00000100:00100000:0.0:1782480882.183611:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311655296 00000100:00100000:0.0:1782480882.183651:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782480882.183661:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+9:3316:x1869066311655296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480882.183718:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+9:3316:x1869066311655296:12345-0@lo:400:kworker.0 Request processed in 58us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480882.183724:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782480882.183839:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7557ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3316:1869066311655296:0@lo:400:kworker.0 00000040:00080000:1.0:1782480882.184158:0:14262:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1782480882.184163:0:14262:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1782480882.185227:0:14256:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782480882.185240:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782480882.185273:0:14256:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1782480882.185291:0:14256:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3dc3ebf33c024acf 00000100:00080000:1.0:1782480882.185299:0:14256:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782480882.185304:0:14256:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b6d4358e800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1782480882.185333:0:14256:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d75578000 x1869066311655424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782480882.185397:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1869066311655424:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1782480882.185442:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869066311655424 offset 0 length 520: 4 00000100:00080000:1.0:1782480882.185491:0:14256:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1782480882.185562:0:14256:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480882.185567:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480882.185569:0:14256:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1782480882.185572:0:14256:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782480882.185576:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480882.185577:0:14256:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782480882.185580:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782480882.185582:0:14256:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782480882.185585:0:14256:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480882.185587:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480882.185589:0:14256:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782480882.185591:0:14256:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782480882.185593:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480882.185594:0:14256:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782480882.185598:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1782480882.185624:0:14256:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14256:1869066311655552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480882.185669:0:14256:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480882.185697:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311655552 00000100:00100000:1.0:1782480882.185702:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311655552 00000100:00100000:1.0:1782480882.185732:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782480882.185741:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+9:14256:x1869066311655552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480882.185994:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+9:14256:x1869066311655552:12345-0@lo:502:llog_process_th.0 Request processed in 253us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480882.186002:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782480882.186049:0:14256:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51212d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782480882.186068:0:14256:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14256:1869066311655552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782480882.186092:0:14256:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480882.186100:0:14256:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480882.186102:0:14256:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782480882.186105:0:14256:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1782480882.186382:0:14220:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1782480882.186401:0:14220:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782480882.186415:0:14220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82165200/0x3dc3ebf33c024a58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024a5f expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480882.186435:0:14220:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d82165200/0x3dc3ebf33c024a58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024a5f expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480882.186443:0:14220:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9b6d52754000 from 1 10000000:01000000:2.0:1782480882.186445:0:14220:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1782480882.186471:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c024ad6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480882.186480:0:14220:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c024ad6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480882.186488:0:14220:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c024ad6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480882.186503:0:14220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311655680:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782480882.186541:0:14220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480882.186570:0:14220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d460ab900 going to sleep for 11 seconds 00000100:00100000:1.0:1782480882.186625:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311655680 00000100:00100000:1.0:1782480882.186630:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311655680 00000100:00100000:1.0:1782480882.186662:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782480882.186669:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+9:14220:x1869066311655680:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782480882.186678:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480882.186692:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d6e572800/0x3dc3ebf33c024add lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c024ad6 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.186712:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d6e572800/0x3dc3ebf33c024add lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c024ad6 expref: 10 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.186721:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d6e572800/0x3dc3ebf33c024add lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024ad6 expref: 10 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.186729:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572800, rc 0) 00000100:00100000:1.0:1782480882.186787:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+10:14220:x1869066311655680:12345-0@lo:101:mount.lustre.0 Request processed in 118us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480882.186793:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782480882.186981:0:14220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311655680:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782480882.186993:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c024ad6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024add expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480882.187001:0:14220:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c024ad6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c024add expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480882.187540:0:14220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311655808:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1782480882.187579:0:14220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480882.187598:0:14220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d460ab900 going to sleep for 11 seconds 00000100:00100000:2.0:1782480882.187645:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311655808 00000100:00100000:2.0:1782480882.187650:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311655808 00000100:00100000:2.0:1782480882.187717:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782480882.187725:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+10:14220:x1869066311655808:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1782480882.187739:0:14233:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1782480882.187773:0:14233:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1782480882.187850:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+10:14220:x1869066311655808:12345-0@lo:256:mount.lustre.0 Request processed in 125us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480882.187857:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782480882.187999:0:14220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311655808:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1782480882.188538:0:14220:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782480882.188561:0:14220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c024ad6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024add expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.188571:0:14220:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c024ad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024add expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480882.188579:0:14220:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9b6d52754000 from 1 10000000:01000000:3.0:1782480882.188582:0:14220:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782480882.188609:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82165400/0x3dc3ebf33c024ae4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.188617:0:14220:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d82165400/0x3dc3ebf33c024ae4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.188626:0:14220:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d82165400/0x3dc3ebf33c024ae4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480882.188641:0:14220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311655936:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782480882.188675:0:14220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480882.188709:0:14220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49a70540 going to sleep for 11 seconds 00000100:00100000:0.0:1782480882.188830:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311655936 00000100:00100000:0.0:1782480882.188837:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311655936 00000100:00100000:0.0:1782480882.188870:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782480882.188879:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+10:14220:x1869066311655936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782480882.188889:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480882.188902:0:14232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d45d2dc00/0x3dc3ebf33c024aeb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c024ae4 expref: -99 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.189004:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d45d2dc00/0x3dc3ebf33c024aeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c024ae4 expref: 11 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.189015:0:14232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d45d2dc00/0x3dc3ebf33c024aeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024ae4 expref: 11 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.189022:0:14232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2dc00, rc 0) 00000100:00100000:0.0:1782480882.189065:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+11:14220:x1869066311655936:12345-0@lo:101:mount.lustre.0 Request processed in 187us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480882.189072:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782480882.189149:0:14220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311655936:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782480882.189161:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d82165400/0x3dc3ebf33c024ae4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024aeb expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.189170:0:14220:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d82165400/0x3dc3ebf33c024ae4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c024aeb expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480882.189219:0:14220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311656064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782480882.189253:0:14220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480882.189315:0:14220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49a70540 going to sleep for 11 seconds 00000100:00100000:2.0:1782480882.189350:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311656064 00000100:00100000:2.0:1782480882.189355:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311656064 00000100:00100000:2.0:1782480882.189383:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782480882.189390:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+11:14220:x1869066311656064:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782480882.190081:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+11:14220:x1869066311656064:12345-0@lo:501:mount.lustre.0 Request processed in 689us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480882.190091:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782480882.190192:0:14220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311656064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782480882.190230:0:14220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311656192:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782480882.190271:0:14220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480882.190339:0:14220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49a70540 going to sleep for 11 seconds 00000100:00100000:0.0:1782480882.190371:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311656192 00000100:00100000:0.0:1782480882.190377:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311656192 00000100:00100000:0.0:1782480882.190443:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782480882.190452:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+11:14220:x1869066311656192:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782480882.190624:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+11:14220:x1869066311656192:12345-0@lo:503:mount.lustre.0 Request processed in 173us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480882.190631:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782480882.190695:0:14220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311656192:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782480882.191332:0:14264:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14264:1869066311656320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480882.191373:0:14264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480882.191435:0:14264:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49a70480 going to sleep for 11 seconds 00000100:00100000:1.0:1782480882.191464:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311656320 00000100:00100000:1.0:1782480882.191470:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311656320 00000100:00100000:1.0:1782480882.191549:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782480882.191558:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+11:14264:x1869066311656320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480882.191787:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+11:14264:x1869066311656320:12345-0@lo:502:llog_process_th.0 Request processed in 231us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480882.191795:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782480882.191926:0:14264:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14264:1869066311656320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782480882.191956:0:14264:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782480882.191966:0:14264:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480882.191968:0:14264:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1782480882.191976:0:14264:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6d52754000 00000020:00000080:3.0:1782480882.191979:0:14264:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782480882.191987:0:14264:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782480882.191989:0:14264:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480882.191991:0:14264:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1782480882.191993:0:14264:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782480882.191995:0:14264:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480882.191997:0:14264:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782480882.192000:0:14264:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6d52754000 00000020:00000080:3.0:1782480882.192002:0:14264:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1782480882.192061:0:14264:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782480882.192064:0:14264:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480882.192066:0:14264:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1782480882.192068:0:14264:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782480882.192078:0:14264:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480882.192080:0:14264:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1782480882.192085:0:14264:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b6d52754000 00000020:00000080:3.0:1782480882.192086:0:14264:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782480882.192128:0:14264:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14264:1869066311656448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480882.192166:0:14264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480882.199796:0:14264:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49a70480 going to sleep for 11 seconds 00000100:00100000:2.0:1782480882.202995:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311656448 00000100:00100000:2.0:1782480882.203014:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311656448 00000100:00100000:2.0:1782480882.203070:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782480882.203080:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+11:14264:x1869066311656448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480882.203350:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+11:14264:x1869066311656448:12345-0@lo:502:llog_process_th.0 Request processed in 269us (11182us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480882.203358:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782480882.205059:0:14264:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14264:1869066311656448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782480882.205107:0:14264:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782480882.205116:0:14264:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480882.205118:0:14264:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1782480882.205123:0:14264:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1782480882.205882:0:14220:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1782480882.205980:0:14220:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782480882.206008:0:14220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82165400/0x3dc3ebf33c024ae4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024aeb expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.206020:0:14220:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d82165400/0x3dc3ebf33c024ae4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024aeb expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480882.206070:0:14220:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782480882.206073:0:14220:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b6d52754000 10000000:01000000:3.0:1782480882.206076:0:14220:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b6d52754000 10000000:01000000:3.0:1782480882.206080:0:14220:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782480882.206086:0:14220:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9b6d52754000 from 1 10000000:01000000:3.0:1782480882.206089:0:14220:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782480882.206123:0:14220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82165a00/0x3dc3ebf33c024af2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.206131:0:14220:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d82165a00/0x3dc3ebf33c024af2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.206149:0:14220:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d82165a00/0x3dc3ebf33c024af2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480882.206171:0:14220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311656576:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782480882.206235:0:14220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480882.206272:0:14220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75c05c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782480882.206438:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311656576 00000100:00100000:2.0:1782480882.206444:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311656576 00000100:00100000:2.0:1782480882.207012:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782480882.207024:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+11:14220:x1869066311656576:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782480882.207045:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480882.207059:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d582e8600/0x3dc3ebf33c024af9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c024af2 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480882.207085:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d582e8600/0x3dc3ebf33c024af9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c024af2 expref: 12 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480882.207095:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d582e8600/0x3dc3ebf33c024af9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024af2 expref: 12 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480882.207104:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e8600, rc 0) 00000100:00100000:2.0:1782480882.207158:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14220:x1869066311656576:12345-0@lo:101:mount.lustre.0 Request processed in 136us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480882.207164:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782480882.207256:0:14220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311656576:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782480882.207272:0:14220:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d82165a00/0x3dc3ebf33c024af2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024af9 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.207281:0:14220:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d82165a00/0x3dc3ebf33c024af2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c024af9 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480882.207337:0:14220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311656704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782480882.207367:0:14220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480882.212133:0:14220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75c05c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782480882.212548:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311656704 00000100:00100000:1.0:1782480882.212563:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311656704 00000100:00100000:1.0:1782480882.212609:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782480882.212618:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14220:x1869066311656704:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782480882.213232:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14220:x1869066311656704:12345-0@lo:501:mount.lustre.0 Request processed in 613us (5862us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480882.213241:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782480882.215206:0:14220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311656704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782480882.215268:0:14220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311656832:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782480882.215336:0:14220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480882.215379:0:14220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75c05c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782480882.215434:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311656832 00000100:00100000:1.0:1782480882.215440:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311656832 00000100:00100000:1.0:1782480882.215493:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1782480882.215502:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14220:x1869066311656832:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782480882.215699:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14220:x1869066311656832:12345-0@lo:503:mount.lustre.0 Request processed in 197us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480882.215706:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782480882.215866:0:14220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473da680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311656832:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782480882.216250:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14269:1869066311656960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480882.216290:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480882.216312:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311656960 00000100:00100000:1.0:1782480882.216316:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311656960 00000100:00100000:1.0:1782480882.216351:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782480882.216359:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14269:x1869066311656960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480882.216548:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14269:x1869066311656960:12345-0@lo:502:llog_process_th.0 Request processed in 190us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480882.216555:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782480882.216592:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51212900 going to sleep for 11 seconds 00000100:00100000:1.0:1782480882.216605:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14269:1869066311656960:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1782480882.216658:0:14269:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1782480882.216673:0:14269:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9b6d756299c0) 00000020:00000080:1.0:1782480882.216700:0:14269:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1782480882.216883:0:14269:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6d52754000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782480882.216888:0:14269:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b6d52754000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782480882.216891:0:14269:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9b6d52754000 4 00010000:00080000:1.0:1782480882.218027:0:14269:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6d46053000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:1.0:1782480882.224416:0:14269:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1782480882.224538:0:14269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1782480882.224575:0:14269:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782480882.224588:0:14269:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3dc3ebf33c024b07 00000100:00080000:1.0:1782480882.224599:0:14269:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782480882.224605:0:14269:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b6d46053000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1782480882.224643:0:14269:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d75578380 x1869066311657088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782480882.224674:0:14269:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1782480882.225115:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869066311657088:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782480882.225182:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480882.226092:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311657088 00000100:00100000:1.0:1782480882.226103:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311657088 00000100:00100000:1.0:1782480882.226143:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782480882.226153:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1869066311657088:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782480882.226207:0:14269:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14269:1869066311657216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480882.226232:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1869066311657088:12345-0@lo:38:llog_process_th.0 Request processed in 78us (1049us total) trans 0 rc -11/-11 00000100:00100000:1.0:1782480882.226241:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782480882.226267:0:14269:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480882.226283:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1782480882.226301:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311657216 00000100:00100000:0.0:1782480882.226305:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311657216 00000100:00100000:0.0:1782480882.226336:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782480882.226342:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14269:x1869066311657216:12345-0@lo:502:llog_process_th.0 00000100:00080000:1.0:1782480882.226370:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9b6d46053000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782480882.226375:0:3314:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1782480882.226379:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869066311657088:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782480882.226571:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14269:x1869066311657216:12345-0@lo:502:llog_process_th.0 Request processed in 229us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480882.226588:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782480882.226632:0:14269:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46016a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782480882.226644:0:14269:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14269:1869066311657216:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1782480882.226664:0:14269:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1782480882.226834:0:14220:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1782480882.226858:0:14220:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782480882.226870:0:14220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82165a00/0x3dc3ebf33c024af2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024af9 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.226880:0:14220:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d82165a00/0x3dc3ebf33c024af2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024af9 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782480882.226993:0:14220:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782480882.226996:0:14220:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782480882.226997:0:14220:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480882.226998:0:14220:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782480882.226999:0:14220:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480882.227001:0:14220:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480882.227002:0:14220:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782480882.227004:0:14220:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782480882.227006:0:14220:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480882.227007:0:14220:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782480882.227011:0:14220:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1782480882.227013:0:14220:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782480882.227015:0:14220:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782480882.227016:0:14220:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480882.227017:0:14220:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782480882.227018:0:14220:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480882.227018:0:14220:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480882.227020:0:14220:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782480882.227021:0:14220:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782480882.227022:0:14220:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480882.227023:0:14220:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782480882.227038:0:14220:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1782480882.227048:0:14220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311657344:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782480882.227080:0:14220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480882.227104:0:14220:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75c05d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782480882.227229:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311657344 00000100:00100000:0.0:1782480882.227234:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311657344 00000100:00100000:0.0:1782480882.227319:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782480882.227328:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14220:x1869066311657344:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782480882.227347:0:14232:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1782480882.227361:0:14232:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1782480882.262468:0:14232:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782480882.262517:0:14232:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1782480882.263168:0:14254:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1782480882.263174:0:14254:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1782480882.263199:0:14254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c024b0e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.263229:0:14254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d6e572800/0x3dc3ebf33c024add lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024ad6 expref: 12 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.263238:0:14254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c024b0e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.263276:0:14254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d6e572800/0x3dc3ebf33c024add lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c024ad6 expref: 12 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.263290:0:14254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d6e572800/0x3dc3ebf33c024add lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c024ad6 expref: 12 pid: 14231 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480882.263305:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14254:1869066311657472:0@lo:104: 00000100:00100000:3.0:1782480882.263378:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480882.263424:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75c05480 going to sleep for 11 seconds 00000100:00100000:1.0:1782480882.263567:0:14221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311657472 00000100:00100000:1.0:1782480882.263575:0:14221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311657472 00000100:00100000:1.0:1782480882.263611:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782480882.263627:0:14221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+3:14254:x1869066311657472:12345-0@lo:104: 00010000:00010000:1.0:1782480882.263639:0:14221:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c024ad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c024add expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.263701:0:14221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782480882.263708:0:14221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+3:14254:x1869066311657472:12345-0@lo:104: Request processed in 83us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480882.263716:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1782480882.263736:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480882.263741:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c024ad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c024add expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.263772:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9a00 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:1.0:1782480882.263776:0:14227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c024ad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c024add expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.263785:0:14227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c024ad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c024add expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782480882.263792:0:14227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c024ad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c024add expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480882.263797:0:14227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782480882.263824:0:14227:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c024ad6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c024add expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.263830:0:14227:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782480882.263851:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c024ad6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c024add expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.263868:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d582e9a00/0x3dc3ebf33c024ad6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c024add expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.263884:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480882.263886:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480882.263887:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480882.263920:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3316:1869066311657600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782480882.263949:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480882.263992:0:14223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311657600 00000100:00100000:1.0:1782480882.263996:0:14223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311657600 00010000:00010000:1.0:1782480882.264012:0:14223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d6e572800/0x3dc3ebf33c024add lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c024ad6 expref: 13 pid: 14231 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480882.264032:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782480882.264039:0:14223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75579180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+13:3316:x1869066311657600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782480882.264049:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480882.264066:0:14223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d6e572800/0x3dc3ebf33c024add lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c024ad6 expref: 13 pid: 14231 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.264077:0:14223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d6e572800/0x3dc3ebf33c024add lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c024ad6 expref: 13 pid: 14231 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.264092:0:14223:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c024b0e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.264099:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c024b0e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782480882.264112:0:14223:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000938611s 00010000:00010000:1.0:1782480882.264122:0:14223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c024b0e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.264129:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c024b0e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.264136:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c024b0e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.264142:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c024b0e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.264147:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d82164800 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480882.264150:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c024b0e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.264157:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c024b0e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.264164:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c024b0e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.264174:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480882.264202:0:14223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75579180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+13:3316:x1869066311657600:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480882.264209:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782480882.264245:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3316:1869066311657600:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782480882.264719:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d6e572800/0x3dc3ebf33c024add lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c024ad6 expref: 12 pid: 14231 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480882.264730:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14254:1869066311657472:0@lo:104: 00010000:00010000:3.0:1782480882.264743:0:14254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c024b0e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.264773:0:14254:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c024b0e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.264780:0:14254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c024b0e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.264798:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c024b0e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480882.284885:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+11:14220:x1869066311657344:12345-0@lo:253:mount.lustre.0 Request processed in 57409us (57654us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480882.284980:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782480882.285261:0:14220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14220:1869066311657344:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782480882.285276:0:14220:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1782480882.285279:0:14220:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782480882.285281:0:14220:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782480882.285282:0:14220:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480882.285283:0:14220:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782480882.285284:0:14220:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480882.285285:0:14220:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480882.285287:0:14220:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782480882.285288:0:14220:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782480882.285290:0:14220:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480882.285291:0:14220:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782480882.285307:0:14220:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1782480882.297447:0:14220:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480882.297645:0:14220:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1782480882.298245:0:14220:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480882.298420:0:14220:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1782480882.298726:0:14220:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480882.299235:0:14220:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1782480882.300231:0:14220:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480882.300403:0:14220:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1782480882.303147:0:14220:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480882.303484:0:14220:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1782480882.304046:0:14220:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480882.304238:0:14220:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1782480882.337030:0:14220:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1782480882.338464:0:14220:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1782480882.338687:0:14276:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1782480882.338692:0:14276:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1782480882.339078:0:14277:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1782480882.339171:0:14277:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782480882.346887:0:14277:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:01000000:2.0:1782480882.347032:0:14220:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1782480882.347336:0:14220:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1782480882.347579:0:14277:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1782480882.347585:0:14277:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:2.0:1782480882.347999:0:14220:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1782480882.348008:0:14220:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1782480882.348167:0:14220:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782480882.349859:0:14220:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1782480882.352189:0:14220:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1782480882.352396:0:14220:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1782480882.353688:0:14220:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1782480882.356054:0:14220:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1782480882.364078:0:14220:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1782480882.409849:0:14220:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1782480882.409887:0:14220:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4ff41c7b988 00100000:10000000:1.0:1782480882.409894:0:14220:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1782480882.414139:0:14220:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782480882.414158:0:14220:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782480882.414172:0:14220:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1782480882.414194:0:14220:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1782480883.000079:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782480883.261325:0:14271:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782480883.261337:0:14271:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782480883.261738:0:14271:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:2.0:1782480883.261775:0:14271:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:1.0:1782480883.913872:0:14235:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782480883.913881:0:14235:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9b6d52754000 from 6 10000000:01000000:1.0:1782480883.913897:0:14235:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782480883.913949:0:14235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024b15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.913960:0:14235:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024b15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.913971:0:14235:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024b15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480883.913997:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311657728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782480883.914073:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480883.914657:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49339000 going to sleep for 11 seconds 00000100:00100000:3.0:1782480883.915017:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311657728 00000100:00100000:3.0:1782480883.915027:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311657728 00000100:00100000:0.0:1782480883.916765:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782480883.916778:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+11:14235:x1869066311657728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782480883.916795:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480883.916814:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d45d2ce00/0x3dc3ebf33c024b1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c024b15 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.916840:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d45d2ce00/0x3dc3ebf33c024b1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c024b15 expref: 12 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.916850:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d45d2ce00/0x3dc3ebf33c024b1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024b15 expref: 12 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.916868:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2ce00, rc 0) 00000100:00100000:0.0:1782480883.916964:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14235:x1869066311657728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (2891us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480883.916971:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782480883.917070:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311657728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480883.917087:0:14235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024b15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024b1c expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.917096:0:14235:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024b15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c024b1c expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480883.917170:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311657856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1782480883.917211:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480883.918574:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75c05180 going to sleep for 11 seconds 00000100:00100000:1.0:1782480883.918917:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311657856 00000100:00100000:1.0:1782480883.918925:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311657856 00000100:00100000:1.0:1782480883.918969:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782480883.918976:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14235:x1869066311657856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1782480883.919001:0:14231:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782480883.919018:0:14231:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782480883.919022:0:14231:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1782480883.919232:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14235:x1869066311657856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 255us (2020us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480883.919239:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782480883.920473:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311657856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1782480883.920573:0:14235:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782480883.920584:0:14235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024b15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024b1c expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.920596:0:14235:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024b15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024b1c expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.023958:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782480884.280894:0:14271:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782480884.280902:0:14271:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782480884.281331:0:14271:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1782480884.281397:0:14271:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782480884.281432:0:14271:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:2.0:1782480885.047244:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480886.071008:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782480886.875215:0:14520:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1782480887.099081:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782480887.543217:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782480887.543225:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782480887.543240:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782480887.543244:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782480887.543247:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1782480887.543250:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1782480887.543254:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b6d46053000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782480887.543266:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b6d46053000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1782480887.543305:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d75578700 x1869066311658112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782480887.543345:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869066311658112:0@lo:38:kworker.0 00000100:00100000:1.0:1782480887.543410:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480887.543976:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311658112 00000100:00100000:1.0:1782480887.543985:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311658112 00000100:00100000:1.0:1782480887.544020:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782480887.544027:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1869066311658112:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1782480887.544053:0:14240:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:1.0:1782480887.544085:0:14240:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3dc3ebf33c024b23 00000004:00100000:1.0:1782480887.544100:0:14240:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782480887.544227:0:14240:0:(import.c:65:import_set_state_nolock()) ffff9b6d50794800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782480887.544281:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869066311658112:12345-0@lo:38:kworker.0 Request processed in 252us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480887.544288:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782480887.544328:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b6d75578700 x1869066311658112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782480897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782480887.544342:0:3314:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1782480887.544348:0:3314:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1782480887.544362:0:3314:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782480887.544365:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9b6d46053000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782480887.544372:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869066311658112:0@lo:38:kworker.0 00000100:00100000:0.0:1782480887.544509:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7557aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3317:1869066311657984:0@lo:400:kworker.0 00000100:00100000:0.0:1782480887.544544:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480887.545053:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311657984 00000100:00100000:1.0:1782480887.545058:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311657984 00000100:00100000:1.0:1782480887.545140:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782480887.545150:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:3317:x1869066311657984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480887.545207:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:3317:x1869066311657984:12345-0@lo:400:kworker.0 Request processed in 59us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480887.545213:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782480887.545283:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7557aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3317:1869066311657984:0@lo:400:kworker.0 00010000:00010000:0.0:1782480888.119053:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480889.142996:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782480889.732501:0:14671:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdbc268d20 20000000:00000080:3.0:1782480889.732523:0:14671:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b6d77079800 uarg=0000000000000000 20000000:01000000:3.0:1782480889.732559:0:14671:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1782480889.732566:0:14671:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1782480889.732570:0:14671:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1782480889.733579:0:14672:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1782480889.733900:0:14671:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1782480889.757724:0:14671:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782480889.757811:0:14671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d6e572400/0x3dc3ebf33c024b2a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480889.757832:0:14671:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d45d2dc00/0x3dc3ebf33c024aeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024ae4 expref: 11 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480889.757841:0:14671:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d6e572400/0x3dc3ebf33c024b2a lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480889.757893:0:14671:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d45d2dc00/0x3dc3ebf33c024aeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c024ae4 expref: 11 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480889.757910:0:14671:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d45d2dc00/0x3dc3ebf33c024aeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c024ae4 expref: 11 pid: 14232 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480889.757926:0:14671:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14671:1869066311658240:0@lo:104: 00000100:00100000:1.0:1782480889.757997:0:14671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480889.758078:0:14671:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d460abb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782480889.760121:0:14222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311658240 00000100:00100000:0.0:1782480889.760135:0:14222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311658240 00000100:00100000:0.0:1782480889.760185:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782480889.760194:0:14222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+3:14671:x1869066311658240:12345-0@lo:104: 00010000:00010000:0.0:1782480889.760211:0:14222:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d82165400/0x3dc3ebf33c024ae4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c024aeb expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480889.760312:0:14222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782480889.760318:0:14222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+3:14671:x1869066311658240:12345-0@lo:104: Request processed in 125us (2322us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480889.760324:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1782480889.760343:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480889.760348:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d82165400/0x3dc3ebf33c024ae4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c024aeb expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480889.760356:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d82165400 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:0.0:1782480889.760372:0:14227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d82165400/0x3dc3ebf33c024ae4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c024aeb expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480889.761248:0:14227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d82165400/0x3dc3ebf33c024ae4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c024aeb expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480889.761257:0:14227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d82165400/0x3dc3ebf33c024ae4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c024aeb expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480889.761263:0:14227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782480889.761301:0:14227:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d82165400/0x3dc3ebf33c024ae4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c024aeb expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480889.761307:0:14227:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480889.761324:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d82165400/0x3dc3ebf33c024ae4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c024aeb expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480889.761330:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d82165400/0x3dc3ebf33c024ae4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c024aeb expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480889.761350:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480889.761352:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480889.761354:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480889.761443:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3318:1869066311658368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782480889.761491:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480889.761627:0:14223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311658368 00000100:00100000:0.0:1782480889.761633:0:14223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311658368 00010000:00010000:0.0:1782480889.761654:0:14223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d45d2dc00/0x3dc3ebf33c024aeb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c024ae4 expref: 12 pid: 14232 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480889.761685:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782480889.761692:0:14223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:3318:x1869066311658368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782480889.761894:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480889.761910:0:14223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d45d2dc00/0x3dc3ebf33c024aeb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c024ae4 expref: 12 pid: 14232 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480889.761922:0:14223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d45d2dc00/0x3dc3ebf33c024aeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c024ae4 expref: 12 pid: 14232 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480889.761939:0:14223:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d6e572400/0x3dc3ebf33c024b2a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480889.761947:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d6e572400/0x3dc3ebf33c024b2a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480889.761961:0:14223:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d6e572400/0x3dc3ebf33c024b2a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480889.761968:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d6e572400/0x3dc3ebf33c024b2a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480889.761974:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d6e572400/0x3dc3ebf33c024b2a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480889.761980:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d6e572400/0x3dc3ebf33c024b2a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480889.761986:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572400 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:0.0:1782480889.761990:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d6e572400/0x3dc3ebf33c024b2a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480889.761995:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d6e572400/0x3dc3ebf33c024b2a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480889.762003:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d6e572400/0x3dc3ebf33c024b2a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480889.762018:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480889.762168:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3318:1869066311658368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480889.762218:0:14223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:3318:x1869066311658368:12345-0@lo:103:ldlm_bl.0 Request processed in 526us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480889.762225:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1782480889.762995:0:14671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d45d2dc00/0x3dc3ebf33c024aeb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c024ae4 expref: 11 pid: 14232 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480889.763020:0:14671:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14671:1869066311658240:0@lo:104: 00010000:00010000:1.0:1782480889.763039:0:14671:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d6e572400/0x3dc3ebf33c024b2a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480889.763050:0:14671:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d6e572400/0x3dc3ebf33c024b2a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480889.763056:0:14671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d6e572400/0x3dc3ebf33c024b2a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480889.763062:0:14671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d6e572400/0x3dc3ebf33c024b2a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480890.166905:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782480891.063941:0:14235:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782480891.063949:0:14235:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9b6d52754000 from 10 10000000:01000000:2.0:1782480891.063954:0:14235:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782480891.064008:0:14235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8800/0x3dc3ebf33c024b31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480891.064020:0:14235:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8800/0x3dc3ebf33c024b31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480891.064031:0:14235:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8800/0x3dc3ebf33c024b31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480891.064061:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311658496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782480891.064148:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480891.064210:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51ed7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782480891.065615:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311658496 00000100:00100000:0.0:1782480891.065627:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311658496 00000100:00100000:0.0:1782480891.065913:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782480891.065924:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+11:14235:x1869066311658496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782480891.065939:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480891.065957:0:14232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d45d2ca00/0x3dc3ebf33c024b38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c024b31 expref: -99 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480891.065984:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d45d2ca00/0x3dc3ebf33c024b38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c024b31 expref: 12 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480891.065994:0:14232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d45d2ca00/0x3dc3ebf33c024b38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024b31 expref: 12 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480891.066002:0:14232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2ca00, rc 0) 00000100:00100000:0.0:1782480891.066068:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14235:x1869066311658496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480891.066075:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782480891.066162:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311658496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480891.066181:0:14235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8800/0x3dc3ebf33c024b31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024b38 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480891.066192:0:14235:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8800/0x3dc3ebf33c024b31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c024b38 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480891.066258:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311658624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480891.066293:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480891.066328:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d47c78a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782480891.066419:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311658624 00000100:00100000:0.0:1782480891.066425:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311658624 00000100:00100000:0.0:1782480891.066457:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782480891.066465:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14235:x1869066311658624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480891.066989:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14235:x1869066311658624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 522us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480891.067004:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782480891.067506:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311658624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480891.067569:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311658752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480891.067617:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480891.067658:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d47c78a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782480891.067880:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311658752 00000100:00100000:2.0:1782480891.067887:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311658752 00000100:00100000:2.0:1782480891.067931:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782480891.067940:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14235:x1869066311658752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480891.068115:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14235:x1869066311658752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480891.068123:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782480891.068408:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311658752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782480891.069573:0:14732:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1782480891.069932:0:14235:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1782480891.069954:0:14235:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782480891.069965:0:14235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8800/0x3dc3ebf33c024b31 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024b38 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480891.069976:0:14235:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8800/0x3dc3ebf33c024b31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024b38 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480891.191777:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480892.217075:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782480892.662928:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782480892.662935:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782480892.662938:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782480892.662940:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782480892.663359:0:3314:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782480882/real 1782480882] req@ffff9b6d75578000 x1869066311655424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782480892 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480892.663384:0:3314:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b6d75578000 x1869066311655424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782480892 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480892.663393:0:3314:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782480882/real 1782480882] req@ffff9b6d7f2d4a80 x1869066311655168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782480892 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480892.663404:0:3314:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b6d7f2d4a80 x1869066311655168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782480892 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782480892.663420:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9b6d4358e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782480892.663477:0:3314:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782480892.663482:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1869066311655424:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1782480892.663498:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9b6d43583800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782480892.663730:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782480892.663735:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1782480892.663738:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b6d43583800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782480892.663742:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 503 00000100:00080000:0.0:1782480892.663792:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782480892.663802:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b6d43583800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1782480892.663827:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d750f9c00 x1869066311659136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782480892.663837:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782480892.663840:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782480892.663841:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b6d4358e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782480892.663844:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 503 00000100:00080000:0.0:1782480892.663847:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1782480892.663850:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b6d4358e800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1782480892.663873:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d750fa680 x1869066311659264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782480892.664106:0:3314:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782480892.664111:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1869066311655168:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1782480892.664141:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1869066311659136:0@lo:8:kworker.0 00000400:00000100:1.0:1782480892.664193:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869066311659136 offset 0 length 520: 4 00000100:00100000:1.0:1782480892.664230:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1869066311659264:0@lo:8:kworker.0 00000400:00000100:1.0:1782480892.664247:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869066311659264 offset 0 length 520: 4 00000100:00100000:1.0:1782480892.664271:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3315:1869066311658880:0@lo:400:kworker.0 00000100:00100000:1.0:1782480892.664317:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480892.664352:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782480892.664358:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311659008:0@lo:400:kworker.0 00000100:00100000:3.0:1782480892.664379:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311658880 00000100:00100000:1.0:1782480892.664385:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480892.664389:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311658880 00000100:00100000:1.0:1782480892.664434:0:14239:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311659008 00000100:00100000:1.0:1782480892.664439:0:14239:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311659008 00000100:00100000:3.0:1782480892.664440:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782480892.664451:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:3315:x1869066311658880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480892.664472:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782480892.664481:0:14239:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311659008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480892.664512:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:3315:x1869066311658880:12345-0@lo:400:kworker.0 Request processed in 62us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480892.664520:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782480892.665018:0:14239:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311659008:12345-0@lo:400:kworker.0 Request processed in 538us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480892.665026:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782480892.665062:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b6d473d8a80 x1869066311659008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480892.665075:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311659008:0@lo:400:kworker.0 00000100:00100000:1.0:1782480892.665084:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3315:1869066311658880:0@lo:400:kworker.0 00010000:00010000:1.0:1782480893.241251:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782480893.992997:0:14872:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782480893.993002:0:14872:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1782480893.993140:0:14872:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b6d657b4800 00000020:01000004:2.0:1782480893.993154:0:14872:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1782480893.993166:0:14872:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1782480893.993180:0:14872:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b6d4845cd40) 00000020:00000080:2.0:1782480893.993194:0:14872:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1782480894.034416:0:14872:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1782480894.037162:0:14872:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1782480894.042373:0:14872:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1782480894.042674:0:14872:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1782480894.042959:0:14872:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1782480894.046310:0:14872:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 381: rc = 0 00100000:10000000:0.0:1782480894.047272:0:14872:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 381: rc = 0 00100000:10000000:0.0:1782480894.047394:0:14872:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 381: rc = 0 00100000:10000000:0.0:1782480894.049668:0:14872:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 594: rc = 0 00100000:10000000:0.0:1782480894.050906:0:14872:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 594: rc = 0 00100000:10000000:0.0:1782480894.051740:0:14872:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 594: rc = 0 00100000:10000000:0.0:1782480894.052349:0:14872:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 594: rc = 0 00100000:10000000:0.0:1782480894.052899:0:14872:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 594: rc = 0 00100000:10000000:0.0:1782480894.053284:0:14872:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 594: rc = 0 00000020:00000080:0.0:1782480894.054173:0:14872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1782480894.054185:0:14872:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1782480894.054194:0:14872:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3dc3ebf33c024b46 00000020:01000004:0.0:1782480894.054203:0:14872:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1782480894.054225:0:14872:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.151@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1782480894.054228:0:14872:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1782480894.054233:0:14872:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1782480894.054237:0:14872:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1782480894.054248:0:14872:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b6d460bcd40) 00000020:00000080:0.0:1782480894.054260:0:14872:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1782480894.055530:0:14872:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782480894.055684:0:14872:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1782480894.055690:0:14872:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1782480894.056838:0:14872:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1782480894.056850:0:14872:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1782480894.062885:0:14872:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1782480894.063431:0:14872:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1782480894.068159:0:14872:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782480894.068369:0:14872:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1782480894.068376:0:14872:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1782480894.069507:0:14872:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1782480894.069515:0:14872:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1782480894.096972:0:14872:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782480894.097533:0:14872:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1782480894.097540:0:14872:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1782480894.099183:0:14872:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1782480894.099194:0:14872:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1782480894.100539:0:14872:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1782480894.100551:0:14872:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1782480894.104538:0:14872:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782480894.104722:0:14872:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1782480894.104728:0:14872:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1782480894.107366:0:14872:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1782480894.107383:0:14872:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1782480894.160500:0:14872:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782480894.160744:0:14872:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1782480894.160773:0:14872:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1782480894.162235:0:14872:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1782480894.162246:0:14872:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1782480894.163538:0:14872:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1782480894.163560:0:14872:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1782480894.163565:0:14872:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1782480894.181042:0:14872:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782480894.181098:0:14872:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.151@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1782480894.181104:0:14872:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782480894.181106:0:14872:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782480894.181107:0:14872:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480894.181108:0:14872:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782480894.181110:0:14872:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480894.181111:0:14872:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480894.181112:0:14872:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782480894.181114:0:14872:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480894.181115:0:14872:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782480894.181119:0:14872:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1782480894.181122:0:14872:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782480894.181123:0:14872:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782480894.181125:0:14872:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480894.181126:0:14872:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782480894.181127:0:14872:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480894.181128:0:14872:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480894.181129:0:14872:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782480894.181131:0:14872:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480894.181131:0:14872:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782480894.181165:0:14872:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1782480894.181186:0:14872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311659392:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782480894.181256:0:14872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480894.181435:0:14872:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45cf8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782480894.181532:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311659392 00000100:00100000:0.0:1782480894.181540:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311659392 00000100:00100000:0.0:1782480894.181630:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782480894.181640:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14872:x1869066311659392:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782480894.181683:0:14231:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1782480894.181687:0:14231:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1782480894.181691:0:14231:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1782480894.193510:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14872:x1869066311659392:12345-0@lo:253:mount.lustre.0 Request processed in 11863us (12244us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480894.193525:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782480894.193682:0:14872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311659392:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1782480894.193699:0:14872:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1782480894.193702:0:14872:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782480894.193704:0:14872:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782480894.193705:0:14872:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782480894.193706:0:14872:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782480894.193707:0:14872:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782480894.193709:0:14872:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782480894.193710:0:14872:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782480894.193712:0:14872:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782480894.193713:0:14872:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782480894.193732:0:14872:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b6d657b4800 from lustre-OST0000 10000000:01000000:0.0:1782480894.193783:0:14872:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1782480894.193786:0:14872:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1782480894.193792:0:14872:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b6d7562cd40 local copy 00010000:00010000:0.0:1782480894.193803:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c024a3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024a43 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480894.194264:0:14872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311659520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782480894.194314:0:14872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480894.194687:0:14872:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f38e600 going to sleep for 11 seconds 00000100:00100000:3.0:1782480894.195164:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311659520 00000100:00100000:3.0:1782480894.195172:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311659520 00000100:00100000:3.0:1782480894.195271:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782480894.195280:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14872:x1869066311659520:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782480894.195513:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14872:x1869066311659520:12345-0@lo:501:mount.lustre.0 Request processed in 233us (1197us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782480894.195520:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782480894.195710:0:14872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311659520:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1782480894.195729:0:14872:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1782480894.195929:0:14872:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1782480894.195939:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c024a3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024a43 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.195948:0:14872:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c024a3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024a43 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480894.195972:0:14872:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b6d657b4800 10000000:01000000:0.0:1782480894.195983:0:14872:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1782480894.195988:0:14872:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b6d7562cd40 10000000:01000000:0.0:1782480894.195991:0:14872:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1782480894.196006:0:14872:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9b6d7562cd40 from 1 10000000:01000000:0.0:1782480894.196009:0:14872:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782480894.196039:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d45d2d800/0x3dc3ebf33c024b54 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.196048:0:14872:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d45d2d800/0x3dc3ebf33c024b54 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.196057:0:14872:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d45d2d800/0x3dc3ebf33c024b54 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480894.196075:0:14872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311659648:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1782480894.196108:0:14872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480894.199956:0:14872:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f38e600 going to sleep for 11 seconds 00000100:00100000:3.0:1782480894.200136:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311659648 00000100:00100000:3.0:1782480894.200145:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311659648 00000100:00100000:3.0:1782480894.200252:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782480894.200263:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+12:14872:x1869066311659648:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782480894.200281:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480894.200318:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d82164e00/0x3dc3ebf33c024b5b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c024b54 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480894.200353:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d82164e00/0x3dc3ebf33c024b5b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c024b54 expref: 13 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480894.200363:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d82164e00/0x3dc3ebf33c024b5b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024b54 expref: 13 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480894.200371:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d82164e00, rc 0) 00000100:00100000:3.0:1782480894.200459:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+13:14872:x1869066311659648:12345-0@lo:101:mount.lustre.0 Request processed in 197us (4348us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480894.200476:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782480894.200575:0:14872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750faa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311659648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782480894.200591:0:14872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d45d2d800/0x3dc3ebf33c024b54 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024b5b expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480894.200601:0:14872:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d45d2d800/0x3dc3ebf33c024b54 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c024b5b expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480894.200628:0:14872:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782480894.200642:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d45d2d800/0x3dc3ebf33c024b54 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024b5b expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480894.200650:0:14872:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d45d2d800/0x3dc3ebf33c024b54 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024b5b expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480894.200659:0:14872:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1782480894.200664:0:14872:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782480894.200670:0:14872:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1782480894.200673:0:14872:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1782480894.200696:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573200/0x3dc3ebf33c024b62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480894.200704:0:14872:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573200/0x3dc3ebf33c024b62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480894.200712:0:14872:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573200/0x3dc3ebf33c024b62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480894.200732:0:14872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311659776:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782480894.200798:0:14872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480894.201505:0:14872:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51c33cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480894.201635:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311659776 00000100:00100000:0.0:1782480894.201641:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311659776 00000100:00100000:0.0:1782480894.201672:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782480894.201679:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+13:14872:x1869066311659776:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782480894.201689:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480894.201701:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d45d2de00/0x3dc3ebf33c024b69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c024b62 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.201719:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d45d2de00/0x3dc3ebf33c024b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c024b62 expref: 14 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.201727:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d45d2de00/0x3dc3ebf33c024b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024b62 expref: 14 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.202115:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2de00, rc 0) 00000100:00100000:0.0:1782480894.202209:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+14:14872:x1869066311659776:12345-0@lo:101:mount.lustre.0 Request processed in 530us (1410us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480894.202217:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782480894.202288:0:14872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311659776:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782480894.202423:0:14872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573200/0x3dc3ebf33c024b62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024b69 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480894.202434:0:14872:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573200/0x3dc3ebf33c024b62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c024b69 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782480894.209793:0:14872:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1782480894.211184:0:14872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782480894.212551:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1782480894.213267:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1782480894.213409:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1782480894.213464:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1782480894.213494:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1782480894.213520:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1782480894.213733:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1782480894.213743:0:14872:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1782480894.213864:0:14872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311659904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782480894.213930:0:14872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480894.214038:0:14872:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51c33780 going to sleep for 11 seconds 00000100:00100000:3.0:1782480894.218879:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311659904 00000100:00100000:3.0:1782480894.218893:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311659904 00000100:00100000:0.0:1782480894.219031:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782480894.219040:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+14:14872:x1869066311659904:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782480894.219492:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+14:14872:x1869066311659904:12345-0@lo:501:mount.lustre.0 Request processed in 452us (5561us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480894.219500:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782480894.219633:0:14872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311659904:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782480894.219707:0:14872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311660032:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782480894.219880:0:14872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480894.219921:0:14872:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45d2b300 going to sleep for 11 seconds 00000100:00100000:3.0:1782480894.219926:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311660032 00000100:00100000:3.0:1782480894.219932:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311660032 00000100:00100000:3.0:1782480894.219956:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782480894.219967:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+14:14872:x1869066311660032:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782480894.220432:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+14:14872:x1869066311660032:12345-0@lo:503:mount.lustre.0 Request processed in 468us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480894.220440:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782480894.220621:0:14872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311660032:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1782480894.222425:0:14872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782480894.222862:0:14872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311660160:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782480894.222935:0:14872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480894.222981:0:14872:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45d2b300 going to sleep for 11 seconds 00000100:00100000:3.0:1782480894.223465:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311660160 00000100:00100000:3.0:1782480894.223473:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311660160 00000100:00100000:3.0:1782480894.223518:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1782480894.223526:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+14:14872:x1869066311660160:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782480894.223910:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+14:14872:x1869066311660160:12345-0@lo:502:mount.lustre.0 Request processed in 383us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480894.223918:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782480894.224031:0:14872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311660160:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782480894.224656:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1782480894.225698:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1782480894.225914:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1782480894.225975:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1782480894.227539:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1782480894.227954:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1782480894.228021:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1782480894.228543:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1782480894.228651:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1782480894.228703:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1782480894.228964:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1782480894.229253:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1782480894.229434:0:14872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311660288:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782480894.229724:0:14872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480894.229809:0:14872:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45d2b300 going to sleep for 11 seconds 00000100:00100000:3.0:1782480894.229905:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311660288 00000100:00100000:3.0:1782480894.229913:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311660288 00000100:00100000:3.0:1782480894.229957:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782480894.229966:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+14:14872:x1869066311660288:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782480894.230890:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+14:14872:x1869066311660288:12345-0@lo:502:mount.lustre.0 Request processed in 923us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480894.230899:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1782480894.231452:0:14872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311660288:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782480894.231571:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1782480894.231586:0:14872:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1782480894.233665:0:14886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782480894.233733:0:14886:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1782480894.233741:0:14886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480894.234142:0:14886:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1782480894.234152:0:14886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782480894.234167:0:14886:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b6d484599c0) 00000020:00000080:2.0:1782480894.234193:0:14886:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1782480894.234197:0:14886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782480894.234257:0:14886:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6d657b4800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1782480894.234264:0:14886:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782480894.234285:0:14886:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3dc3ebf33c024b77 00010000:00010000:2.0:1782480894.244104:0:14886:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1782480894.245144:0:14886:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1782480894.252653:0:14886:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1782480894.255070:0:14886:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1782480894.255080:0:14886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782480894.255086:0:14886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480894.255089:0:14886:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1782480894.255094:0:14886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1782480894.255096:0:14886:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1782480894.255098:0:14886:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782480894.255100:0:14886:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1782480894.255101:0:14886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1782480894.255103:0:14886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480894.255105:0:14886:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1782480894.255107:0:14886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782480894.255119:0:14886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480894.255121:0:14886:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782480894.255125:0:14886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782480894.255126:0:14886:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782480894.255128:0:14886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782480894.255130:0:14886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480894.255132:0:14886:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1782480894.255134:0:14886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782480894.255142:0:14886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480894.255144:0:14886:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782480894.255148:0:14886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1782480894.255209:0:14886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782480894.255212:0:14886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480894.255213:0:14886:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782480894.255216:0:14886:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1782480894.255311:0:14872:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1782480894.255348:0:14872:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1782480894.255370:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573200/0x3dc3ebf33c024b62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024b69 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480894.255383:0:14872:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573200/0x3dc3ebf33c024b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024b69 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480894.255392:0:14872:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9b6d657b4800 from 1 10000000:01000000:2.0:1782480894.255395:0:14872:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782480894.255447:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8c00/0x3dc3ebf33c024b7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480894.255456:0:14872:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8c00/0x3dc3ebf33c024b7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480894.255466:0:14872:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8c00/0x3dc3ebf33c024b7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480894.255491:0:14872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311660416:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782480894.255579:0:14872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480894.255621:0:14872:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d46016900 going to sleep for 11 seconds 00000100:00100000:0.0:1782480894.255739:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311660416 00000100:00100000:0.0:1782480894.255768:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311660416 00000100:00100000:0.0:1782480894.255814:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782480894.255825:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+14:14872:x1869066311660416:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782480894.255840:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480894.255852:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d45d2cc00/0x3dc3ebf33c024b85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c024b7e expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.255875:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d45d2cc00/0x3dc3ebf33c024b85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c024b7e expref: 15 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.255885:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d45d2cc00/0x3dc3ebf33c024b85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024b7e expref: 15 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.255893:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2cc00, rc 0) 00000100:00100000:0.0:1782480894.255948:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+15:14872:x1869066311660416:12345-0@lo:101:mount.lustre.0 Request processed in 125us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480894.255954:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782480894.256124:0:14872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311660416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782480894.256140:0:14872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8c00/0x3dc3ebf33c024b7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024b85 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480894.256149:0:14872:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8c00/0x3dc3ebf33c024b7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c024b85 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782480894.256902:0:14872:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1782480894.257447:0:14872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782480894.257767:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1782480894.257818:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1782480894.257882:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1782480894.257890:0:14872:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1782480894.257964:0:14872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311660544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782480894.258031:0:14872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480894.258074:0:14872:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d53c07480 going to sleep for 11 seconds 00000100:00100000:0.0:1782480894.258147:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311660544 00000100:00100000:0.0:1782480894.258154:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311660544 00000100:00100000:0.0:1782480894.258202:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1782480894.258211:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+15:14872:x1869066311660544:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782480894.258471:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+15:14872:x1869066311660544:12345-0@lo:501:mount.lustre.0 Request processed in 259us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480894.258484:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782480894.258940:0:14872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311660544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782480894.258978:0:14872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311660672:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782480894.259031:0:14872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480894.259061:0:14872:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d53c07480 going to sleep for 11 seconds 00000100:00100000:0.0:1782480894.259180:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311660672 00000100:00100000:0.0:1782480894.259185:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311660672 00000100:00100000:0.0:1782480894.259223:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1782480894.259231:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+15:14872:x1869066311660672:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782480894.259822:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+15:14872:x1869066311660672:12345-0@lo:503:mount.lustre.0 Request processed in 590us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480894.259829:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782480894.261937:0:14872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311660672:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782480894.262647:0:14872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782480894.262766:0:14872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311660800:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782480894.262838:0:14872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480894.262881:0:14872:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d5a3609c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480894.263196:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311660800 00000100:00100000:2.0:1782480894.263203:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311660800 00010000:00010000:3.0:1782480894.263248:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480894.264963:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782480894.264986:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+15:14872:x1869066311660800:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782480894.266403:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+15:14872:x1869066311660800:12345-0@lo:502:mount.lustre.0 Request processed in 1420us (3559us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480894.266539:0:14872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311660800:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782480894.266983:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1782480894.267063:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1782480894.267137:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1782480894.267183:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1782480894.267222:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1782480894.267308:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1782480894.267352:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1782480894.267387:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1782480894.267430:0:14872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311660928:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782480894.267485:0:14872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480894.267525:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311660928 00000100:00100000:0.0:1782480894.267532:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311660928 00000100:00100000:1.0:1782480894.271818:0:14872:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d485e5540 going to sleep for 11 seconds 00000100:00100000:2.0:1782480894.272364:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782480894.276013:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782480894.276038:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+15:14872:x1869066311660928:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782480894.276413:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+15:14872:x1869066311660928:12345-0@lo:502:mount.lustre.0 Request processed in 384us (8926us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480894.276423:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782480894.276568:0:14872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311660928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782480894.276734:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1782480894.277687:0:14872:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1782480894.283080:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782480894.283200:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480894.283204:0:14890:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782480894.283213:0:14890:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6d657b4800 00000020:00000080:0.0:1782480894.283216:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782480894.283223:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782480894.283226:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480894.283227:0:14890:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1782480894.283229:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782480894.283232:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480894.283233:0:14890:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782480894.283236:0:14890:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6d657b4800 00000020:00000080:0.0:1782480894.283238:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782480894.283306:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782480894.283309:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480894.283311:0:14890:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1782480894.283313:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782480894.283315:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480894.283316:0:14890:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782480894.283319:0:14890:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b6d657b4800 00000020:00000080:0.0:1782480894.283321:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782480894.283357:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782480894.283361:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480894.283362:0:14890:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1782480894.283365:0:14890:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1782480894.284256:0:14872:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1782480894.284314:0:14872:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782480894.284339:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8c00/0x3dc3ebf33c024b7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024b85 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480894.284352:0:14872:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8c00/0x3dc3ebf33c024b7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024b85 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480894.284405:0:14872:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782480894.284409:0:14872:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b6d657b4800 10000000:01000000:1.0:1782480894.284412:0:14872:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b6d657b4800 10000000:01000000:1.0:1782480894.284417:0:14872:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782480894.284423:0:14872:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9b6d657b4800 from 1 10000000:01000000:1.0:1782480894.284426:0:14872:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782480894.284467:0:14872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573a00/0x3dc3ebf33c024b8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480894.284484:0:14872:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573a00/0x3dc3ebf33c024b8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480894.284495:0:14872:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573a00/0x3dc3ebf33c024b8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480894.284524:0:14872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75579f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311661056:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782480894.284937:0:14872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480894.285080:0:14872:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51c33780 going to sleep for 11 seconds 00000100:00100000:2.0:1782480894.286186:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311661056 00000100:00100000:2.0:1782480894.286196:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311661056 00000100:00100000:3.0:1782480894.286787:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782480894.286798:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+15:14872:x1869066311661056:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782480894.286814:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480894.286832:0:14232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c024b93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c024b8c expref: -99 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480894.286871:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c024b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c024b8c expref: 16 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480894.286882:0:14232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d82164800/0x3dc3ebf33c024b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024b8c expref: 16 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480894.286902:0:14232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d82164800, rc 0) 00000100:00100000:3.0:1782480894.286971:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:14872:x1869066311661056:12345-0@lo:101:mount.lustre.0 Request processed in 174us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480894.286987:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782480894.287192:0:14872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75579f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311661056:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782480894.287212:0:14872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573a00/0x3dc3ebf33c024b8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024b93 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480894.287228:0:14872:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573a00/0x3dc3ebf33c024b8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c024b93 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782480894.287900:0:14872:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1782480894.289141:0:14872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782480894.289523:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1782480894.289594:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1782480894.289631:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1782480894.289705:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1782480894.289771:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1782480894.289833:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1782480894.289889:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1782480894.289945:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1782480894.290342:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1782480894.290388:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1782480894.290440:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1782480894.290506:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1782480894.290675:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1782480894.290710:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1782480894.290785:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1782480894.290849:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1782480894.290923:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1782480894.291120:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1782480894.291159:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1782480894.291188:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1782480894.291234:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1782480894.291487:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1782480894.291535:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1782480894.291604:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1782480894.291638:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1782480894.291672:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1782480894.291716:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1782480894.291790:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1782480894.291892:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1782480894.291902:0:14872:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1782480894.294354:0:14872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75579f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311661184:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782480894.294422:0:14872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480894.294459:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311661184 00000100:00100000:1.0:1782480894.294465:0:14872:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51c33780 going to sleep for 11 seconds 00000100:00100000:0.0:1782480894.294468:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311661184 00000100:00100000:0.0:1782480894.294527:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782480894.294537:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:14872:x1869066311661184:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782480894.294960:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:14872:x1869066311661184:12345-0@lo:501:mount.lustre.0 Request processed in 423us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480894.294976:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782480894.295115:0:14872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75579f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311661184:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782480894.295154:0:14872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75579f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311661312:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782480894.295193:0:14872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480894.295218:0:14872:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51c33780 going to sleep for 11 seconds 00000100:00100000:0.0:1782480894.295498:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311661312 00000100:00100000:0.0:1782480894.295505:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311661312 00000100:00100000:0.0:1782480894.295540:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782480894.295548:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:14872:x1869066311661312:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782480894.295889:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:14872:x1869066311661312:12345-0@lo:503:mount.lustre.0 Request processed in 340us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480894.295896:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782480894.297187:0:14872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75579f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311661312:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782480894.297976:0:14872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782480894.298549:0:14872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75579f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311661440:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782480894.298694:0:14872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480894.298801:0:14872:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51c33780 going to sleep for 11 seconds 00000100:00100000:2.0:1782480894.299132:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311661440 00000100:00100000:2.0:1782480894.299139:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311661440 00000100:00100000:2.0:1782480894.299186:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782480894.299193:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:14872:x1869066311661440:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782480894.300156:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:14872:x1869066311661440:12345-0@lo:502:mount.lustre.0 Request processed in 958us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480894.300166:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782480894.300403:0:14872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75579f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311661440:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782480894.300848:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1782480894.300906:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1782480894.300942:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1782480894.301489:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1782480894.301831:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1782480894.301898:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1782480894.301951:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1782480894.302399:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1782480894.302460:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1782480894.302499:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1782480894.302534:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1782480894.303118:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1782480894.303159:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1782480894.303192:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1782480894.303242:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1782480894.303636:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1782480894.303679:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1782480894.303734:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1782480894.303805:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1782480894.303843:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1782480894.303894:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1782480894.303931:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1782480894.304632:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1782480894.304695:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1782480894.305106:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1782480894.305155:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1782480894.305205:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1782480894.305244:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1782480894.305658:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1782480894.305714:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1782480894.306129:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1782480894.306169:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1782480894.306200:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1782480894.306251:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1782480894.306896:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1782480894.307455:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1782480894.307510:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1782480894.308082:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1782480894.308173:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1782480894.308212:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1782480894.309085:0:14872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311661568:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782480894.309173:0:14872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480894.309220:0:14872:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d6048d900 going to sleep for 11 seconds 00000100:00100000:3.0:1782480894.309246:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311661568 00000100:00100000:3.0:1782480894.309254:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311661568 00000100:00100000:3.0:1782480894.312469:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782480894.312482:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:14872:x1869066311661568:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782480894.314242:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:14872:x1869066311661568:12345-0@lo:502:mount.lustre.0 Request processed in 1755us (5062us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480894.314445:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782480894.314672:0:14872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311661568:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782480894.314806:0:14872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1782480894.314822:0:14872:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1782480894.322916:0:14895:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1782480894.322936:0:14895:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b6d6d893380) 00000020:00000080:3.0:1782480894.322958:0:14895:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1782480894.323710:0:14895:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6d657b4800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1782480894.323716:0:14895:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b6d657b4800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1782480894.323718:0:14895:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9b6d657b4800 3 00010000:00080000:3.0:1782480894.323775:0:14895:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6d74c76800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.151@tcp at head 00010000:00010000:3.0:1782480894.328202:0:14895:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1782480894.328317:0:14895:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1782480894.328590:0:14895:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1782480894.328607:0:14895:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3dc3ebf33c024ba1 00000100:00080000:2.0:1782480894.328620:0:14895:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782480894.328626:0:14895:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b6d74c76800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1782480894.328665:0:14895:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d7f2d7800 x1869066311661696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782480894.328698:0:14895:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1782480894.328858:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1869066311661696:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782480894.328925:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782480894.329002:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782480894.329007:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782480894.329009:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782480894.329012:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1782480894.330179:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869066311661824:0@lo:400:kworker.0 00000100:00100000:0.0:1782480894.330231:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1782480894.330445:0:14895:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1782480894.330790:0:14872:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1782480894.330817:0:14872:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782480894.330836:0:14872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573a00/0x3dc3ebf33c024b8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024b93 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480894.330846:0:14872:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573a00/0x3dc3ebf33c024b8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024b93 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782480894.330894:0:14872:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782480894.330896:0:14872:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782480894.330898:0:14872:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782480894.330899:0:14872:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782480894.330900:0:14872:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782480894.330901:0:14872:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782480894.330903:0:14872:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782480894.330905:0:14872:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782480894.330906:0:14872:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782480894.330910:0:14872:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1782480894.330912:0:14872:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782480894.330914:0:14872:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782480894.330915:0:14872:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782480894.330916:0:14872:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782480894.330917:0:14872:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782480894.330918:0:14872:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782480894.330919:0:14872:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782480894.330920:0:14872:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782480894.330921:0:14872:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782480894.330943:0:14872:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1782480894.330958:0:14872:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75579c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311661952:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1782480894.331019:0:14872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480894.331055:0:14872:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d51c33cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480894.332464:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311661696 00000100:00100000:2.0:1782480894.332476:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311661696 00000100:00100000:2.0:1782480894.332518:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311661824 00000100:00100000:2.0:1782480894.332524:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311661824 00000100:00100000:2.0:1782480894.332562:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782480894.332572:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869066311661824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480894.332657:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869066311661824:12345-0@lo:400:kworker.0 Request processed in 86us (2424us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480894.332664:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782480894.332681:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782480894.332685:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3314:x1869066311661696:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1782480894.332706:0:14238:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:2.0:1782480894.332739:0:14238:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3dc3ebf33c024ba8 00000004:00100000:2.0:1782480894.332776:0:14238:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782480894.332812:0:14238:0:(import.c:65:import_set_state_nolock()) ffff9b6d43a99800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782480894.332858:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869066311661696:12345-0@lo:38:llog_process_th.0 Request processed in 171us (3933us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480894.332865:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782480894.332886:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311661952 00000100:00100000:2.0:1782480894.332890:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311661952 00000100:00100000:2.0:1782480894.332915:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782480894.332921:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f318c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:14872:x1869066311661952:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1782480894.332941:0:14231:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1782480894.332953:0:14231:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1782480894.333174:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d473db800 x1869066311661824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480894.333190:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869066311661824:0@lo:400:kworker.0 00010000:00080000:2.0:1782480894.333854:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d7f2d7800 x1869066311661696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782480904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480894.333872:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782480894.333879:0:3314:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1782480894.333887:0:3314:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1782480894.333892:0:3314:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1782480894.333895:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9b6d74c76800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1782480894.333903:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3314:1869066311661696:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1782480894.362313:0:14231:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782480894.362336:0:14231:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1782480894.362409:0:14254:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782480894.362414:0:14254:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782480894.362438:0:14254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d45d2d000/0x3dc3ebf33c024baf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.362458:0:14254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d45d2ce00/0x3dc3ebf33c024b1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024b15 expref: 16 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.362467:0:14254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d45d2d000/0x3dc3ebf33c024baf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.362507:0:14254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d45d2ce00/0x3dc3ebf33c024b1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c024b15 expref: 16 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.362538:0:14254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d45d2ce00/0x3dc3ebf33c024b1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c024b15 expref: 16 pid: 14233 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480894.362553:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14254:1869066311662080:0@lo:104: 00000100:00100000:0.0:1782480894.362618:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480894.362669:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d47c78240 going to sleep for 11 seconds 00000100:00100000:2.0:1782480894.363213:0:14222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311662080 00000100:00100000:2.0:1782480894.363222:0:14222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311662080 00000100:00100000:3.0:1782480894.363728:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782480894.363739:0:14221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+3:14254:x1869066311662080:12345-0@lo:104: 00010000:00010000:3.0:1782480894.363780:0:14221:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024b15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c024b1c expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480894.363863:0:14221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782480894.363869:0:14221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+3:14254:x1869066311662080:12345-0@lo:104: Request processed in 133us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480894.363876:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1782480894.364060:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480894.364067:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024b15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c024b1c expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480894.364074:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572c00 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:1.0:1782480894.364078:0:14227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024b15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c024b1c expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480894.364086:0:14227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024b15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c024b1c expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782480894.364093:0:14227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024b15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c024b1c expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480894.364099:0:14227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1782480894.364161:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14254:1869066311662080:0@lo:104: 00010000:00010000:1.0:1782480894.364171:0:14227:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024b15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c024b1c expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480894.364177:0:14227:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480894.364182:0:14254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d45d2d000/0x3dc3ebf33c024baf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480894.364207:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024b15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c024b1c expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480894.364214:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024b15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c024b1c expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480894.364230:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480894.364232:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480894.364234:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480894.364272:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480894.364486:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7557a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3317:1869066311662208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480894.364519:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480894.364570:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311662208 00000100:00100000:0.0:1782480894.364575:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311662208 00010000:00010000:0.0:1782480894.364593:0:14225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d45d2ce00/0x3dc3ebf33c024b1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c024b15 expref: 17 pid: 14233 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480894.364617:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782480894.364624:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+17:3317:x1869066311662208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782480894.364636:0:14225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480894.364642:0:14225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d45d2ce00/0x3dc3ebf33c024b1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c024b15 expref: 17 pid: 14233 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.364653:0:14225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d45d2ce00/0x3dc3ebf33c024b1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c024b15 expref: 17 pid: 14233 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.364666:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d45d2ce00/0x3dc3ebf33c024b1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c024b15 expref: 17 pid: 14233 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.364798:0:14225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d45d2d000/0x3dc3ebf33c024baf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.364806:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d45d2d000/0x3dc3ebf33c024baf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782480894.364821:0:14225:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002407250s 00010000:00010000:0.0:1782480894.364826:0:14225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d45d2d000/0x3dc3ebf33c024baf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.364833:0:14225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d45d2d000/0x3dc3ebf33c024baf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.364839:0:14225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d45d2d000/0x3dc3ebf33c024baf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.364846:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d45d2d000/0x3dc3ebf33c024baf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.364851:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2d000 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:0.0:1782480894.364854:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d45d2d000/0x3dc3ebf33c024baf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.364860:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d45d2d000/0x3dc3ebf33c024baf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.364935:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d45d2d000/0x3dc3ebf33c024baf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.364946:0:14225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480894.364981:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:3317:x1869066311662208:12345-0@lo:103:ldlm_bl.0 Request processed in 358us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480894.364988:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782480894.365159:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7557a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3317:1869066311662208:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782480894.365183:0:14254:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d45d2d000/0x3dc3ebf33c024baf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.365189:0:14254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d45d2d000/0x3dc3ebf33c024baf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480894.365195:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d45d2d000/0x3dc3ebf33c024baf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480894.372523:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f318c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+15:14872:x1869066311661952:12345-0@lo:253:mount.lustre.0 Request processed in 39591us (41494us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480894.372551:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1782480894.372647:0:14872:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75579c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14872:1869066311661952:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1782480894.372668:0:14872:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1782480894.372671:0:14872:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782480894.372673:0:14872:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1782480894.372674:0:14872:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782480894.372676:0:14872:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782480894.372677:0:14872:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782480894.372678:0:14872:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782480894.372679:0:14872:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782480894.372682:0:14872:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782480894.372683:0:14872:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1782480894.372701:0:14872:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1782480894.379426:0:14872:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1782480894.380019:0:14872:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1782480894.380471:0:14872:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1782480894.380795:0:14872:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1782480894.380968:0:14872:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1782480894.381214:0:14872:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1782480894.382879:0:14872:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1782480894.438181:0:14872:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1782480894.438190:0:14872:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1782480894.438223:0:14872:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782480894.438300:0:14872:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782480894.438315:0:14872:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1782480894.438345:0:14872:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000040:00080000:1.0:1782480894.520503:0:14271:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1782480895.287028:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782480896.183805:0:14235:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782480896.183813:0:14235:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9b6d52754000 from 7 10000000:01000000:3.0:1782480896.183819:0:14235:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782480896.183867:0:14235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1e400/0x3dc3ebf33c024bb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480896.183878:0:14235:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1e400/0x3dc3ebf33c024bb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480896.183888:0:14235:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1e400/0x3dc3ebf33c024bb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480896.183914:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311662336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782480896.183984:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480896.184038:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75790600 going to sleep for 11 seconds 00000100:00100000:1.0:1782480896.184869:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311662336 00000100:00100000:1.0:1782480896.184878:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311662336 00000100:00100000:1.0:1782480896.184929:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782480896.184939:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f318850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+15:14235:x1869066311662336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480896.184954:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480896.184969:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d6e573800/0x3dc3ebf33c024bbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c024bb6 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480896.184994:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d6e573800/0x3dc3ebf33c024bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c024bb6 expref: 16 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480896.185004:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d6e573800/0x3dc3ebf33c024bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024bb6 expref: 16 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480896.185024:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573800, rc 0) 00000100:00100000:1.0:1782480896.185090:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f318850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:14235:x1869066311662336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480896.185097:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782480896.185300:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311662336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782480896.185316:0:14235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1e400/0x3dc3ebf33c024bb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024bbd expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480896.185325:0:14235:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1e400/0x3dc3ebf33c024bb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c024bbd expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480896.185386:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311662464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1782480896.185436:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480896.185473:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d485e5840 going to sleep for 11 seconds 00000100:00100000:2.0:1782480896.185537:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311662464 00000100:00100000:2.0:1782480896.185543:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311662464 00000100:00100000:2.0:1782480896.185588:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782480896.185596:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f319050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:14235:x1869066311662464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1782480896.185610:0:14231:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782480896.185624:0:14231:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782480896.185627:0:14231:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1782480896.185711:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f319050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:14235:x1869066311662464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480896.185718:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782480896.185970:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311662464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782480896.186028:0:14235:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782480896.186037:0:14235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1e400/0x3dc3ebf33c024bb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024bbd expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480896.186054:0:14235:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1e400/0x3dc3ebf33c024bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024bbd expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480896.314139:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480897.341964:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480898.359017:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480899.382980:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782480899.833794:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782480899.833802:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782480899.833804:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782480899.833807:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782480899.841076:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782480899.841107:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1869066311662848:0@lo:400:kworker.0 00000100:00100000:3.0:1782480899.841143:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3315:1869066311662592:0@lo:400:kworker.0 00000100:00100000:2.0:1782480899.844779:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480899.846141:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480899.846209:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480899.846403:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311662720:0@lo:400:kworker.0 00000100:00100000:3.0:1782480899.846466:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480899.846518:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311662848 00000100:00100000:3.0:1782480899.846526:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311662848 00000100:00100000:3.0:1782480899.846572:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311662720 00000100:00100000:3.0:1782480899.846575:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311662720 00000100:00100000:3.0:1782480899.846591:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782480899.846598:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869066311662848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480899.846652:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869066311662848:12345-0@lo:400:kworker.0 Request processed in 54us (1883us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480899.846659:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782480899.846675:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782480899.846680:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311662720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480899.846706:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311662720:12345-0@lo:400:kworker.0 Request processed in 27us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480899.846713:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1782480899.846737:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782480899.846868:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d473d9c00 x1869066311662848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480899.846882:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1869066311662848:0@lo:400:kworker.0 00010000:00080000:3.0:1782480899.847150:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d473dbb80 x1869066311662720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480899.847160:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311662720:0@lo:400:kworker.0 00000100:00100000:0.0:1782480899.847388:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311662592 00000100:00100000:0.0:1782480899.847394:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311662592 00000100:00100000:0.0:1782480899.847435:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782480899.847442:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f319850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:3315:x1869066311662592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480899.847486:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f319850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:3315:x1869066311662592:12345-0@lo:400:kworker.0 Request processed in 45us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480899.847492:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782480899.847570:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3315:1869066311662592:0@lo:400:kworker.0 00010000:00010000:3.0:1782480900.407410:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782480901.071067:0:15240:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782480901.431019:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480902.456046:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480903.479128:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480904.503255:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782480904.771260:0:14271:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1782480904.951171:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782480904.951179:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1782480904.951197:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782480904.951200:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1782480904.951251:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782480904.951271:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3317:1869066311662976:0@lo:400:kworker.0 00000100:00100000:2.0:1782480904.951355:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480904.951407:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311663104:0@lo:400:kworker.0 00000100:00100000:2.0:1782480904.951440:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480904.951459:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782480904.951464:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311663232:0@lo:400:kworker.0 00000100:00100000:2.0:1782480904.951483:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480904.951508:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311663104 00000100:00100000:2.0:1782480904.951515:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311663104 00000100:00100000:2.0:1782480904.951552:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311663232 00000100:00100000:2.0:1782480904.951555:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311663232 00000100:00100000:2.0:1782480904.951581:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782480904.951590:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311663104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480904.951639:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311663104:12345-0@lo:400:kworker.0 Request processed in 50us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480904.951646:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782480904.951660:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782480904.951666:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311663232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480904.951688:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311663232:12345-0@lo:400:kworker.0 Request processed in 23us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480904.951693:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1782480904.951708:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782480904.951731:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d7f2d6300 x1869066311663232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480904.951784:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311663232:0@lo:400:kworker.0 00010000:00080000:2.0:1782480904.951798:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d7f2d5f80 x1869066311663104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480904.951807:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311663104:0@lo:400:kworker.0 00000100:00100000:1.0:1782480904.952204:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311662976 00000100:00100000:1.0:1782480904.952211:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311662976 00000100:00100000:1.0:1782480904.952252:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782480904.952260:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f318450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:3317:x1869066311662976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480904.952302:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f318450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:3317:x1869066311662976:12345-0@lo:400:kworker.0 Request processed in 42us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480904.952309:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782480904.952360:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3317:1869066311662976:0@lo:400:kworker.0 00010000:00010000:1.0:1782480905.533387:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480906.551122:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782480907.212341:0:15541:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1782480907.212345:0:15541:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1782480907.212449:0:15541:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b6d74e86800 00000020:01000004:0.0:1782480907.212464:0:15541:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1782480907.212476:0:15541:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1782480907.212489:0:15541:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b6d460b8000) 00000020:00000080:0.0:1782480907.212505:0:15541:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1782480907.238599:0:15541:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1782480907.238991:0:15541:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1782480907.239689:0:15541:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1782480907.240012:0:15541:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1782480907.240218:0:15541:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1782480907.240533:0:15541:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 513: rc = 0 00100000:10000000:3.0:1782480907.240627:0:15541:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 513: rc = 0 00100000:10000000:3.0:1782480907.240930:0:15541:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 513: rc = 0 00100000:10000000:3.0:1782480907.241327:0:15541:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 650: rc = 0 00100000:10000000:3.0:1782480907.241669:0:15541:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 650: rc = 0 00100000:10000000:3.0:1782480907.242004:0:15541:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 650: rc = 0 00100000:10000000:3.0:1782480907.242259:0:15541:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 650: rc = 0 00100000:10000000:3.0:1782480907.242498:0:15541:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 650: rc = 0 00100000:10000000:3.0:1782480907.242892:0:15541:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 650: rc = 0 00000020:00000080:3.0:1782480907.243443:0:15541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1782480907.243454:0:15541:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782480907.243464:0:15541:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3dc3ebf33c024bcb 00000020:01000004:3.0:1782480907.243472:0:15541:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1782480907.243491:0:15541:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.204.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782480907.243495:0:15541:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782480907.243500:0:15541:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1782480907.243522:0:15541:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1782480907.243527:0:15541:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1782480907.264739:0:15541:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782480907.264806:0:15541:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.151@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1782480907.264811:0:15541:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782480907.264813:0:15541:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782480907.264814:0:15541:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480907.264816:0:15541:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782480907.264817:0:15541:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480907.264818:0:15541:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480907.264820:0:15541:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782480907.264821:0:15541:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480907.264822:0:15541:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782480907.264826:0:15541:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1782480907.264828:0:15541:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782480907.264829:0:15541:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782480907.264830:0:15541:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480907.264831:0:15541:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782480907.264832:0:15541:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480907.264833:0:15541:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480907.264834:0:15541:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782480907.264836:0:15541:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480907.264837:0:15541:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782480907.264873:0:15541:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1782480907.265655:0:15541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311663360:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782480907.265733:0:15541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480907.265829:0:15541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d6d88e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480907.265845:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311663360 00000100:00100000:2.0:1782480907.265855:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311663360 00000100:00100000:2.0:1782480907.265914:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1782480907.265924:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f31a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:15541:x1869066311663360:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1782480907.265956:0:14231:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1782480907.265960:0:14231:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1782480907.265964:0:14231:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1782480907.288959:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f31a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:15541:x1869066311663360:12345-0@lo:253:mount.lustre.0 Request processed in 23029us (23218us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480907.288973:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1782480907.289232:0:15541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311663360:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782480907.289248:0:15541:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1782480907.289251:0:15541:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782480907.289253:0:15541:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782480907.289254:0:15541:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480907.289256:0:15541:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782480907.289257:0:15541:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480907.289258:0:15541:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480907.289260:0:15541:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782480907.289262:0:15541:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480907.289263:0:15541:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782480907.289284:0:15541:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b6d74e86800 from lustre-OST0001 10000000:01000000:3.0:1782480907.289446:0:15541:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1782480907.289460:0:15541:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782480907.289468:0:15541:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b6d7562cd40 local copy 00010000:00010000:3.0:1782480907.289479:0:15541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c024a3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024a43 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480907.289874:0:15541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311663488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782480907.289919:0:15541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480907.290012:0:15541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d6d88e000 going to sleep for 11 seconds 00000100:00100000:1.0:1782480907.290230:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311663488 00000100:00100000:1.0:1782480907.290238:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311663488 00000100:00100000:1.0:1782480907.290473:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782480907.290485:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f31bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:15541:x1869066311663488:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782480907.290697:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f31bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:15541:x1869066311663488:12345-0@lo:501:mount.lustre.0 Request processed in 214us (776us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782480907.290705:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782480907.290787:0:15541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311663488:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1782480907.290812:0:15541:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782480907.290955:0:15541:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782480907.290964:0:15541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c024a3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024a43 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.290974:0:15541:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d82165c00/0x3dc3ebf33c024a3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024a43 expref: -99 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480907.290996:0:15541:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b6d74e86800 10000000:01000000:3.0:1782480907.291000:0:15541:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782480907.291016:0:15541:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782480907.291019:0:15541:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782480907.291024:0:15541:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1782480907.291027:0:15541:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782480907.291062:0:15541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1f600/0x3dc3ebf33c024bd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.291072:0:15541:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1f600/0x3dc3ebf33c024bd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.291090:0:15541:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1f600/0x3dc3ebf33c024bd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480907.291106:0:15541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311663616:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782480907.291135:0:15541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480907.291771:0:15541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d6d88e000 going to sleep for 11 seconds 00000100:00100000:2.0:1782480907.292098:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311663616 00000100:00100000:2.0:1782480907.292105:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311663616 00000100:00100000:2.0:1782480907.292140:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782480907.292148:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f31a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:15541:x1869066311663616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782480907.292161:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480907.292175:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d582e9a00/0x3dc3ebf33c024bd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c024bd2 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.292200:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d582e9a00/0x3dc3ebf33c024bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c024bd2 expref: 17 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.292212:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d582e9a00/0x3dc3ebf33c024bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024bd2 expref: 17 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.292220:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9a00, rc 0) 00000100:00100000:2.0:1782480907.292276:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f31a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+17:15541:x1869066311663616:12345-0@lo:101:mount.lustre.0 Request processed in 128us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480907.292283:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782480907.292502:0:15541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311663616:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782480907.292517:0:15541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1f600/0x3dc3ebf33c024bd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024bd9 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.292527:0:15541:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1f600/0x3dc3ebf33c024bd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c024bd9 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782480907.294496:0:15541:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1782480907.296255:0:15541:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782480907.296541:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1782480907.296599:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1782480907.296651:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1782480907.296702:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1782480907.296910:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1782480907.296950:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1782480907.297105:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1782480907.297114:0:15541:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1782480907.297209:0:15541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311663744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782480907.297273:0:15541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480907.297321:0:15541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae5d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480907.297701:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311663744 00000100:00100000:1.0:1782480907.297709:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311663744 00000100:00100000:1.0:1782480907.297909:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782480907.297918:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f31a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+17:15541:x1869066311663744:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782480907.298567:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f31a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+17:15541:x1869066311663744:12345-0@lo:501:mount.lustre.0 Request processed in 648us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480907.298577:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782480907.299472:0:15541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311663744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782480907.299527:0:15541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311663872:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782480907.299581:0:15541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480907.299611:0:15541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae5d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480907.299668:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311663872 00000100:00100000:0.0:1782480907.299674:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311663872 00000100:00100000:0.0:1782480907.299722:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782480907.299770:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f31b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+17:15541:x1869066311663872:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782480907.300245:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f31b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+17:15541:x1869066311663872:12345-0@lo:503:mount.lustre.0 Request processed in 499us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480907.300253:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782480907.300544:0:15541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311663872:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1782480907.301536:0:15541:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782480907.301626:0:15541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311664000:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782480907.301685:0:15541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480907.301890:0:15541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae5d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480907.302118:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311664000 00000100:00100000:1.0:1782480907.302125:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311664000 00000100:00100000:1.0:1782480907.302205:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1782480907.302215:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f31b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+17:15541:x1869066311664000:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782480907.302541:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f31b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+17:15541:x1869066311664000:12345-0@lo:502:mount.lustre.0 Request processed in 328us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480907.302550:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782480907.302633:0:15541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311664000:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782480907.302918:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1782480907.302973:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1782480907.303129:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1782480907.303197:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1782480907.303237:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1782480907.303273:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1782480907.303334:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1782480907.303397:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1782480907.303447:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1782480907.303484:0:15541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311664128:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782480907.303531:0:15541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480907.303992:0:15541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae5d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480907.304157:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311664128 00000100:00100000:0.0:1782480907.304164:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311664128 00000100:00100000:0.0:1782480907.304203:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782480907.304213:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f31b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+17:15541:x1869066311664128:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782480907.304526:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f31b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+17:15541:x1869066311664128:12345-0@lo:502:mount.lustre.0 Request processed in 313us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480907.304534:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1782480907.304631:0:15541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311664128:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782480907.304708:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1782480907.304720:0:15541:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1782480907.305815:0:15542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782480907.305824:0:15542:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1782480907.305832:0:15542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480907.305834:0:15542:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1782480907.305841:0:15542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782480907.305855:0:15542:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b6d4845b380) 00000020:00000080:2.0:1782480907.305881:0:15542:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1782480907.305886:0:15542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782480907.305972:0:15542:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6d74e86800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1782480907.305980:0:15542:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782480907.305987:0:15542:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3dc3ebf33c024be7 00010000:00010000:2.0:1782480907.310479:0:15542:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1782480907.311128:0:15542:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1782480907.314670:0:15542:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1782480907.316322:0:15542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1782480907.316334:0:15542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782480907.316406:0:15542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480907.316409:0:15542:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1782480907.316413:0:15542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782480907.316418:0:15542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480907.316420:0:15542:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782480907.316423:0:15542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782480907.316425:0:15542:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782480907.316427:0:15542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782480907.316429:0:15542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480907.316431:0:15542:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1782480907.316433:0:15542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782480907.316435:0:15542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480907.316436:0:15542:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782480907.316439:0:15542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1782480907.316498:0:15542:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782480907.316502:0:15542:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480907.316503:0:15542:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782480907.316514:0:15542:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1782480907.316694:0:15541:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1782480907.316721:0:15541:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1782480907.316801:0:15541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1f600/0x3dc3ebf33c024bd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024bd9 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.316813:0:15541:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1f600/0x3dc3ebf33c024bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024bd9 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480907.316821:0:15541:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9b6d74e86800 from 1 10000000:01000000:1.0:1782480907.316824:0:15541:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782480907.316860:0:15541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024bee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.316869:0:15541:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024bee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.316879:0:15541:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024bee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480907.316913:0:15541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75579c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311664256:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782480907.316981:0:15541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480907.317573:0:15541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49339a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782480907.318290:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311664256 00000100:00100000:0.0:1782480907.318299:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311664256 00000100:00100000:0.0:1782480907.318465:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782480907.318476:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f319c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+17:15541:x1869066311664256:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782480907.318492:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480907.318508:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d45d2d400/0x3dc3ebf33c024bf5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c024bee expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.318534:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d45d2d400/0x3dc3ebf33c024bf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c024bee expref: 18 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.318544:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d45d2d400/0x3dc3ebf33c024bf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024bee expref: 18 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.318552:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2d400, rc 0) 00000100:00100000:0.0:1782480907.318624:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f319c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+18:15541:x1869066311664256:12345-0@lo:101:mount.lustre.0 Request processed in 150us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480907.318631:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782480907.318740:0:15541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75579c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311664256:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782480907.318775:0:15541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024bee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024bf5 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.318784:0:15541:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024bee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c024bf5 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782480907.319558:0:15541:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1782480907.319968:0:15541:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782480907.320599:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1782480907.320647:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1782480907.320709:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1782480907.320718:0:15541:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1782480907.321000:0:15541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311664384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782480907.321303:0:15541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480907.321391:0:15541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d6d88e000 going to sleep for 11 seconds 00000100:00100000:0.0:1782480907.321541:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311664384 00000100:00100000:0.0:1782480907.321549:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311664384 00000100:00100000:0.0:1782480907.321589:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782480907.321596:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f318050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+18:15541:x1869066311664384:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782480907.321845:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f318050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+18:15541:x1869066311664384:12345-0@lo:501:mount.lustre.0 Request processed in 246us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480907.321852:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782480907.322207:0:15541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311664384:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782480907.322249:0:15541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311664512:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782480907.322300:0:15541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480907.322333:0:15541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75626300 going to sleep for 11 seconds 00000100:00100000:2.0:1782480907.322413:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311664512 00000100:00100000:2.0:1782480907.322418:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311664512 00000100:00100000:2.0:1782480907.322446:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1782480907.322461:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f319450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+18:15541:x1869066311664512:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782480907.322704:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f319450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+18:15541:x1869066311664512:12345-0@lo:503:mount.lustre.0 Request processed in 245us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480907.322711:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782480907.322824:0:15541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311664512:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782480907.325678:0:15541:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782480907.326469:0:15541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311664640:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782480907.326547:0:15541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480907.326646:0:15541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75626300 going to sleep for 11 seconds 00000100:00100000:3.0:1782480907.329218:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311664640 00000100:00100000:3.0:1782480907.329234:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311664640 00000100:00100000:3.0:1782480907.329683:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1782480907.329697:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d46589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+18:15541:x1869066311664640:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782480907.330025:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d46589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+18:15541:x1869066311664640:12345-0@lo:502:mount.lustre.0 Request processed in 331us (3476us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480907.331130:0:15541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311664640:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782480907.331497:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1782480907.331556:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1782480907.331625:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1782480907.331664:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1782480907.331694:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1782480907.331839:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1782480907.331879:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1782480907.331914:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1782480907.331957:0:15541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311664768:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782480907.332162:0:15541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480907.332239:0:15541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49339600 going to sleep for 11 seconds 00000100:00100000:0.0:1782480907.332324:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311664768 00000100:00100000:0.0:1782480907.332330:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311664768 00000100:00100000:2.0:1782480907.332514:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782480907.332525:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:15541:x1869066311664768:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782480907.332795:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:15541:x1869066311664768:12345-0@lo:502:mount.lustre.0 Request processed in 271us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480907.332803:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782480907.332829:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782480907.332967:0:15541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311664768:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782480907.333197:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1782480907.333208:0:15541:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1782480907.335191:0:15546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782480907.335203:0:15546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480907.335206:0:15546:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1782480907.335213:0:15546:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6d74e86800 00000020:00000080:0.0:1782480907.335215:0:15546:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782480907.335222:0:15546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782480907.335226:0:15546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480907.335227:0:15546:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1782480907.335229:0:15546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782480907.335232:0:15546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480907.335233:0:15546:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1782480907.335236:0:15546:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b6d74e86800 00000020:00000080:0.0:1782480907.335238:0:15546:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782480907.335339:0:15546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782480907.335411:0:15546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480907.335412:0:15546:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1782480907.335416:0:15546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782480907.335419:0:15546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480907.335420:0:15546:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1782480907.335424:0:15546:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b6d74e86800 00000020:00000080:0.0:1782480907.335426:0:15546:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1782480907.335517:0:15546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782480907.335530:0:15546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480907.335531:0:15546:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1782480907.335534:0:15546:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1782480907.335820:0:15541:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1782480907.335850:0:15541:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782480907.335867:0:15541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024bee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024bf5 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.335879:0:15541:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024bee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024bf5 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480907.335926:0:15541:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782480907.335935:0:15541:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b6d74e86800 10000000:01000000:1.0:1782480907.335938:0:15541:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b6d74e86800 10000000:01000000:1.0:1782480907.335942:0:15541:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782480907.335948:0:15541:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9b6d74e86800 from 1 10000000:01000000:1.0:1782480907.335951:0:15541:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782480907.335986:0:15541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573400/0x3dc3ebf33c024bfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.335995:0:15541:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573400/0x3dc3ebf33c024bfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.336017:0:15541:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573400/0x3dc3ebf33c024bfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480907.336053:0:15541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311664896:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782480907.336117:0:15541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480907.336214:0:15541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d493399c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480907.336307:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311664896 00000100:00100000:3.0:1782480907.336315:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311664896 00000100:00100000:3.0:1782480907.336428:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782480907.336438:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+18:15541:x1869066311664896:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782480907.336453:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480907.336465:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d6ef1f400/0x3dc3ebf33c024c03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c024bfc expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.336488:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d6ef1f400/0x3dc3ebf33c024c03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c024bfc expref: 19 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.336499:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d6ef1f400/0x3dc3ebf33c024c03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024bfc expref: 19 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.336508:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6ef1f400, rc 0) 00000100:00100000:3.0:1782480907.337184:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:15541:x1869066311664896:12345-0@lo:101:mount.lustre.0 Request processed in 744us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480907.337192:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782480907.340151:0:15541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311664896:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782480907.340180:0:15541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573400/0x3dc3ebf33c024bfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024c03 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.340193:0:15541:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573400/0x3dc3ebf33c024bfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c024c03 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782480907.341464:0:15541:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1782480907.342116:0:15541:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782480907.342496:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1782480907.342543:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1782480907.342579:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1782480907.342626:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1782480907.342677:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1782480907.342736:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1782480907.342798:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1782480907.342836:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1782480907.342881:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1782480907.342917:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1782480907.342952:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1782480907.344892:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1782480907.344971:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1782480907.345516:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1782480907.345582:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1782480907.345619:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1782480907.345653:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1782480907.345704:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1782480907.345777:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1782480907.345817:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1782480907.345868:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1782480907.345902:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1782480907.345932:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1782480907.345980:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1782480907.346558:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1782480907.346603:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1782480907.346656:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1782480907.346713:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1782480907.348906:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1782480907.349020:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1782480907.349074:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1782480907.349107:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1782480907.349143:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1782480907.349194:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1782480907.349230:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1782480907.349292:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1782480907.349335:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1782480907.349580:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1782480907.349588:0:15541:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1782480907.349691:0:15541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311665024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782480907.349789:0:15541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480907.349834:0:15541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d493399c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480907.350013:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311665024 00000100:00100000:3.0:1782480907.350027:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311665024 00000100:00100000:3.0:1782480907.350080:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782480907.350090:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:15541:x1869066311665024:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782480907.350315:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:15541:x1869066311665024:12345-0@lo:501:mount.lustre.0 Request processed in 226us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480907.350324:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782480907.350841:0:15541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311665024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782480907.350879:0:15541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311665152:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782480907.350920:0:15541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480907.350950:0:15541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d493399c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480907.351110:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311665152 00000100:00100000:0.0:1782480907.351115:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311665152 00000100:00100000:0.0:1782480907.351148:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782480907.351156:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:15541:x1869066311665152:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782480907.351966:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:15541:x1869066311665152:12345-0@lo:503:mount.lustre.0 Request processed in 808us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480907.351975:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782480907.352121:0:15541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311665152:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782480907.352661:0:15541:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782480907.352741:0:15541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311665280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782480907.352818:0:15541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480907.352844:0:15541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d493399c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480907.353465:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311665280 00000100:00100000:0.0:1782480907.353473:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311665280 00000100:00100000:0.0:1782480907.353513:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782480907.353520:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:15541:x1869066311665280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782480907.353821:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:15541:x1869066311665280:12345-0@lo:502:mount.lustre.0 Request processed in 299us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480907.353828:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782480907.353887:0:15541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311665280:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782480907.354562:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1782480907.354620:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1782480907.354656:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1782480907.354704:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1782480907.354773:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1782480907.354828:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1782480907.354866:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1782480907.354900:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1782480907.354949:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1782480907.354986:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1782480907.357521:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1782480907.357645:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1782480907.357687:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1782480907.357721:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1782480907.357817:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1782480907.357856:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1782480907.357893:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1782480907.357939:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1782480907.357977:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1782480907.358415:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1782480907.358478:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1782480907.358516:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1782480907.358552:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1782480907.358600:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1782480907.358637:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1782480907.358669:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1782480907.358717:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1782480907.358794:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1782480907.358830:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1782480907.358880:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1782480907.358917:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1782480907.358951:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1782480907.358985:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1782480907.361560:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1782480907.361628:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1782480907.361681:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1782480907.361717:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1782480907.363523:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1782480907.363609:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1782480907.363647:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1782480907.363698:0:15541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311665408:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782480907.365193:0:15541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480907.369302:0:15541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75626600 going to sleep for 11 seconds 00000100:00100000:3.0:1782480907.371484:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311665408 00000100:00100000:3.0:1782480907.371500:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311665408 00000100:00100000:3.0:1782480907.372836:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782480907.372853:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:15541:x1869066311665408:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782480907.373175:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:15541:x1869066311665408:12345-0@lo:502:mount.lustre.0 Request processed in 327us (7987us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480907.373183:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782480907.377503:0:15541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311665408:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782480907.377742:0:15541:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1782480907.377777:0:15541:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1782480907.379332:0:15551:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1782480907.380109:0:15551:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b6d460b99c0) 00000020:00000080:0.0:1782480907.380134:0:15551:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1782480907.381452:0:15551:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b6d74e86800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1782480907.381460:0:15551:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b6d74e86800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1782480907.381462:0:15551:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9b6d74e86800 3 00010000:00080000:0.0:1782480907.381500:0:15551:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b6d5108d000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.151@tcp at head 00010000:00010000:0.0:1782480907.387835:0:15551:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1782480907.387930:0:15551:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1782480907.387969:0:15551:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1782480907.387981:0:15551:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3dc3ebf33c024c11 00000100:00080000:0.0:1782480907.387995:0:15551:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782480907.388015:0:15551:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b6d5108d000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1782480907.388059:0:15551:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d750f8a80 x1869066311665536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782480907.388088:0:15551:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1782480907.388117:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782480907.388122:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782480907.388125:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782480907.388127:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1782480907.388910:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869066311665664:0@lo:400:kworker.0 00000100:00100000:1.0:1782480907.388974:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480907.389010:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782480907.389016:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311665792:0@lo:400:kworker.0 00000100:00100000:1.0:1782480907.389050:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480907.389079:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311665664 00000100:00100000:1.0:1782480907.389085:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311665664 00000100:00100000:1.0:1782480907.389122:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311665792 00000100:00100000:1.0:1782480907.389125:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311665792 00000100:00100000:1.0:1782480907.389155:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782480907.389163:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869066311665664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480907.389216:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869066311665664:12345-0@lo:400:kworker.0 Request processed in 52us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480907.389230:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1782480907.389247:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782480907.389253:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311665792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480907.389283:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311665792:12345-0@lo:400:kworker.0 Request processed in 30us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480907.389287:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1782480907.389309:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782480907.389332:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d750faa00 x1869066311665792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480907.389346:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311665792:0@lo:400:kworker.0 00010000:00080000:1.0:1782480907.389357:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d750fad80 x1869066311665664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480907.389364:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869066311665664:0@lo:400:kworker.0 00000100:00100000:2.0:1782480907.390222:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1869066311665536:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782480907.390266:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480907.392157:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311665536 00000100:00100000:1.0:1782480907.392168:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311665536 00000100:00100000:1.0:1782480907.392214:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782480907.392221:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1869066311665536:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1782480907.392258:0:14240:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:1.0:1782480907.392294:0:14240:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3dc3ebf33c024c18 00000004:00100000:1.0:1782480907.392309:0:14240:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782480907.392347:0:14240:0:(import.c:65:import_set_state_nolock()) ffff9b6d7a8ca000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782480907.392414:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869066311665536:12345-0@lo:38:llog_process_th.0 Request processed in 192us (2147us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480907.392421:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1782480907.392470:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b6d750f8a80 x1869066311665536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782480917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480907.392481:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782480907.392488:0:3314:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1782480907.392494:0:3314:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1782480907.392498:0:3314:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782480907.392500:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9b6d5108d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782480907.392506:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3314:1869066311665536:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1782480907.394871:0:15551:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1782480907.395129:0:15541:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1782480907.395158:0:15541:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782480907.395178:0:15541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573400/0x3dc3ebf33c024bfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024c03 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.395190:0:15541:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573400/0x3dc3ebf33c024bfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024c03 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782480907.395245:0:15541:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782480907.395247:0:15541:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782480907.395249:0:15541:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782480907.395250:0:15541:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782480907.395251:0:15541:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782480907.395253:0:15541:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782480907.395254:0:15541:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782480907.395256:0:15541:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782480907.395258:0:15541:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782480907.395261:0:15541:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1782480907.395283:0:15541:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782480907.395284:0:15541:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782480907.395285:0:15541:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782480907.395286:0:15541:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782480907.395287:0:15541:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782480907.395288:0:15541:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782480907.395289:0:15541:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782480907.395290:0:15541:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782480907.395291:0:15541:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782480907.395314:0:15541:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1782480907.395333:0:15541:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311665920:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782480907.395406:0:15541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480907.395442:0:15541:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7b17c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480907.395466:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311665920 00000100:00100000:2.0:1782480907.395473:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311665920 00000100:00100000:2.0:1782480907.395512:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782480907.395520:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:15541:x1869066311665920:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1782480907.395551:0:14232:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1782480907.395565:0:14232:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1782480907.422935:0:14232:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1782480907.422949:0:14232:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1782480907.424513:0:14254:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782480907.424523:0:14254:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782480907.424549:0:14254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d45d2c600/0x3dc3ebf33c024c1f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.424584:0:14254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d6e573800/0x3dc3ebf33c024bbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024bb6 expref: 19 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.424593:0:14254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d45d2c600/0x3dc3ebf33c024c1f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.424636:0:14254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d6e573800/0x3dc3ebf33c024bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c024bb6 expref: 19 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.424652:0:14254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d6e573800/0x3dc3ebf33c024bbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c024bb6 expref: 19 pid: 14233 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480907.424667:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14254:1869066311666048:0@lo:104: 00000100:00100000:0.0:1782480907.424734:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480907.424840:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d75626cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480907.425700:0:14222:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311666048 00000100:00100000:3.0:1782480907.425709:0:14222:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311666048 00000100:00100000:3.0:1782480907.425788:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782480907.425802:0:14222:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+3:14254:x1869066311666048:12345-0@lo:104: 00010000:00010000:3.0:1782480907.425816:0:14222:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1e400/0x3dc3ebf33c024bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c024bbd expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.425877:0:14222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782480907.425884:0:14222:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+3:14254:x1869066311666048:12345-0@lo:104: Request processed in 84us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480907.425892:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782480907.426052:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14254:1869066311666048:0@lo:104: 00010000:00010000:0.0:1782480907.426073:0:14254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d45d2c600/0x3dc3ebf33c024c1f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.426489:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480907.426496:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1e400/0x3dc3ebf33c024bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c024bbd expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.426515:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1e400 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:1.0:1782480907.426519:0:14226:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1e400/0x3dc3ebf33c024bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c024bbd expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.426527:0:14226:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1e400/0x3dc3ebf33c024bb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c024bbd expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782480907.426534:0:14226:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1e400/0x3dc3ebf33c024bb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c024bbd expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480907.426540:0:14226:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782480907.426580:0:14226:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1e400/0x3dc3ebf33c024bb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c024bbd expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.426587:0:14226:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782480907.426611:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1e400/0x3dc3ebf33c024bb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c024bbd expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.426634:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d6ef1e400/0x3dc3ebf33c024bb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c024bbd expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.426651:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480907.426653:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480907.426654:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480907.426669:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3315:1869066311666176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782480907.426707:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480907.426785:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311666176 00000100:00100000:1.0:1782480907.426790:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311666176 00010000:00010000:1.0:1782480907.426816:0:14225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d6e573800/0x3dc3ebf33c024bbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c024bb6 expref: 20 pid: 14233 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480907.426840:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782480907.426849:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+20:3315:x1869066311666176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782480907.426860:0:14225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480907.426865:0:14225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d6e573800/0x3dc3ebf33c024bbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c024bb6 expref: 20 pid: 14233 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.426874:0:14225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d6e573800/0x3dc3ebf33c024bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c024bb6 expref: 20 pid: 14233 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.426886:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d6e573800/0x3dc3ebf33c024bbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c024bb6 expref: 20 pid: 14233 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.426900:0:14225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d45d2c600/0x3dc3ebf33c024c1f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.426916:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d45d2c600/0x3dc3ebf33c024c1f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782480907.426929:0:14225:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002407250s 00010000:00010000:1.0:1782480907.426934:0:14225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d45d2c600/0x3dc3ebf33c024c1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.426941:0:14225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d45d2c600/0x3dc3ebf33c024c1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.426948:0:14225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d45d2c600/0x3dc3ebf33c024c1f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.426954:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d45d2c600/0x3dc3ebf33c024c1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.426960:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c600 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480907.426964:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d45d2c600/0x3dc3ebf33c024c1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.426971:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d45d2c600/0x3dc3ebf33c024c1f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.426985:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d45d2c600/0x3dc3ebf33c024c1f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.426993:0:14225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480907.427024:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:3315:x1869066311666176:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480907.427044:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782480907.427085:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3315:1869066311666176:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782480907.427103:0:14254:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d45d2c600/0x3dc3ebf33c024c1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.427111:0:14254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d45d2c600/0x3dc3ebf33c024c1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.427117:0:14254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d45d2c600/0x3dc3ebf33c024c1f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480907.438558:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+18:15541:x1869066311665920:12345-0@lo:253:mount.lustre.0 Request processed in 43028us (43141us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480907.438596:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782480907.438699:0:15541:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ed2e1d0c-2f63-46f9-ac79-60f348db465e:15541:1869066311665920:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782480907.438716:0:15541:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1782480907.438720:0:15541:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782480907.438722:0:15541:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782480907.438723:0:15541:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782480907.438724:0:15541:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782480907.438725:0:15541:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782480907.438727:0:15541:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782480907.438728:0:15541:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782480907.438731:0:15541:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782480907.438732:0:15541:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782480907.438956:0:15541:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1782480907.447479:0:15541:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1782480907.447665:0:15541:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1782480907.448212:0:15541:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1782480907.448454:0:15541:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1782480907.448595:0:15541:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1782480907.448890:0:15541:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1782480907.449615:0:15541:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1782480907.503618:0:15541:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1782480907.503628:0:15541:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1782480907.503659:0:15541:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1782480907.503713:0:15541:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1782480907.503726:0:15541:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1782480907.503780:0:15541:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1782480907.574972:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480908.418611:0:3314:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782480892/real 1782480892] req@ffff9b6d750f9c00 x1869066311659136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782480907 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480908.418715:0:3314:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b6d750f9c00 x1869066311659136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782480907 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480908.418727:0:3314:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782480892/real 1782480892] req@ffff9b6d750fa680 x1869066311659264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782480907 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480908.418740:0:3314:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b6d750fa680 x1869066311659264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782480907 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782480908.418780:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9b6d43583800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782480908.418806:0:3314:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782480908.418810:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1869066311659136:0@lo:8:kworker.0 00000100:00080000:1.0:1782480908.418816:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9b6d4358e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782480908.418821:0:3314:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1782480908.418825:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1869066311659264:0@lo:8:kworker.0 00000100:00080000:1.0:1782480908.418885:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782480908.418895:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1782480908.418897:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b6d43583800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782480908.418901:0:38:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 513 00000100:00080000:1.0:1782480908.418905:0:38:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1782480908.418911:0:38:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b6d43583800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1782480908.418929:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d75578e00 x1869066311666432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782480908.418940:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782480908.418943:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1782480908.418945:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b6d4358e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782480908.418948:0:38:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 513 00000100:00080000:1.0:1782480908.418950:0:38:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1782480908.418953:0:38:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b6d4358e800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1782480908.418960:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b6d75579c00 x1869066311666560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782480908.419006:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3316:1869066311666304:0@lo:400:kworker.0 00000100:00100000:1.0:1782480908.419074:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480908.419111:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782480908.419116:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066311666944:0@lo:400:kworker.0 00000100:00100000:1.0:1782480908.419136:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480908.419157:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1869066311666432:0@lo:8:kworker.0 00000100:00100000:1.0:1782480908.419175:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480908.419195:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1869066311666560:0@lo:8:kworker.0 00000100:00100000:1.0:1782480908.419210:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480908.419249:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7557a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869066311666688:0@lo:400:kworker.0 00000100:00100000:1.0:1782480908.419268:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480908.419280:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782480908.419284:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311666816:0@lo:400:kworker.0 00000100:00100000:1.0:1782480908.419299:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480908.419322:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311666304 00000100:00100000:1.0:1782480908.419328:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311666304 00000100:00100000:1.0:1782480908.419368:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782480908.419375:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+18:3316:x1869066311666304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480908.419413:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+18:3316:x1869066311666304:12345-0@lo:400:kworker.0 Request processed in 38us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480908.419419:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782480908.419443:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311666944 00000100:00100000:1.0:1782480908.419445:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311666944 00000100:00100000:0.0:1782480908.420300:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311666432 00000100:00100000:0.0:1782480908.420307:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311666432 00000100:00100000:0.0:1782480908.420332:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311666560 00000100:00100000:0.0:1782480908.420334:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311666560 00000100:00100000:0.0:1782480908.420344:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782480908.420350:0:14873:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75578380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3314:x1869066311666432:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1782480908.420373:0:14873:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:0.0:1782480908.420399:0:14873:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3dc3ebf33c024c26 00002000:00100000:0.0:1782480908.420410:0:14873:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b6d7b145000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211365f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1782480908.420421:0:14873:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1782480908.420424:0:14873:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1782480908.420779:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311666688 00000100:00100000:1.0:1782480908.420783:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311666688 00000100:00100000:1.0:1782480908.420794:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311666816 00000100:00100000:1.0:1782480908.420797:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311666816 00000100:00100000:1.0:1782480908.420809:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782480908.420816:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066311666944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480908.420864:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1869066311666944:12345-0@lo:400:kworker.0 Request processed in 49us (1727us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480908.420869:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782480908.420881:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782480908.420886:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869066311666688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480908.420913:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869066311666688:12345-0@lo:400:kworker.0 Request processed in 27us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480908.420929:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782480908.420939:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782480908.420944:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311666816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480908.420971:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311666816:12345-0@lo:400:kworker.0 Request processed in 26us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480908.420976:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1782480908.421034:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d75578700 x1869066311666944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480908.421048:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3316:1869066311666944:0@lo:400:kworker.0 00000100:00100000:1.0:1782480908.421061:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3316:1869066311666304:0@lo:400:kworker.0 00000100:00080000:1.0:1782480908.421083:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782480908.421100:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d75579f80 x1869066311666816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480908.421109:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311666816:0@lo:400:kworker.0 00010000:00080000:1.0:1782480908.421118:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7557a300 x1869066311666688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480908.421132:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7557a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869066311666688:0@lo:400:kworker.0 00002000:00080000:0.0:1782480908.422579:0:14873:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782480908.422612:0:14873:0:(import.c:65:import_set_state_nolock()) ffff9b6d7b140800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782480908.423729:0:14873:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75578380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1869066311666432:12345-0@lo:8:kworker.0 Request processed in 3372us (4546us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480908.423741:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782480908.424024:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782480908.424031:0:14873:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3314:x1869066311666560:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1782480908.424060:0:14873:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:0.0:1782480908.424087:0:14873:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3dc3ebf33c024c2d 00002000:00100000:0.0:1782480908.424100:0:14873:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b6d7b146800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211365f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1782480908.424104:0:14873:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1782480908.424107:0:14873:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:3.0:1782480908.424515:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d75578e00 x1869066311666432/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782480928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480908.424527:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782480908.424904:0:3314:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1782480908.424915:0:3314:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1782480908.424921:0:3314:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1782480908.424925:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9b6d43583800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1782480908.424941:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1782480908.424948:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1869066311666432:0@lo:8:kworker.0 00000004:00080000:2.0:1782480908.425388:0:14261:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1782480908.425413:0:14261:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14261:1869066311667200:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1782480908.425947:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311667072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480908.426626:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1782480908.427410:0:14260:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00002000:00080000:0.0:1782480908.427734:0:14873:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782480908.427783:0:14873:0:(import.c:65:import_set_state_nolock()) ffff9b6d50791000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782480908.427857:0:14873:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1869066311666560:12345-0@lo:8:kworker.0 Request processed in 3823us (8644us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480908.427868:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782480908.428132:0:14261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480908.428160:0:14261:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7b17cf00 going to sleep for 11 seconds 00010000:00080000:3.0:1782480908.428940:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d75579c00 x1869066311666560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782480928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480908.428959:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782480908.428968:0:3314:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1782480908.428977:0:3314:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1782480908.428983:0:3314:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1782480908.428986:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9b6d4358e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1782480908.429009:0:3314:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1782480908.429025:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3314:1869066311666560:0@lo:8:kworker.0 00000004:00080000:2.0:1782480908.429132:0:14263:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1782480908.429156:0:14263:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14263:1869066311667456:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1782480908.429205:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480908.429226:0:14263:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7b17c240 going to sleep for 11 seconds 00000100:00100000:2.0:1782480908.429252:0:14876:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311667200 00000100:00100000:2.0:1782480908.429258:0:14876:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311667200 00000100:00100000:3.0:1782480908.429267:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311667328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480908.429303:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480908.429308:0:14876:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311667456 00000100:00100000:2.0:1782480908.429313:0:14876:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311667456 00000100:00100000:2.0:1782480908.429337:0:14876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782480908.429398:0:14876:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14261:x1869066311667200:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1782480908.433152:0:14260:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 529274383333ns, next at 0ns, rc = 0 00000100:00080000:1.0:1782480908.433245:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782480908.433262:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480908.433300:0:14878:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311667072 00000100:00100000:1.0:1782480908.433325:0:14878:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311667072 00000100:00100000:1.0:1782480908.433386:0:14878:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311667328 00000100:00100000:1.0:1782480908.433397:0:14878:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311667328 00000100:00100000:3.0:1782480908.434000:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782480908.434025:0:14877:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1869066311667072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480908.434060:0:14877:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480908.434148:0:14877:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1869066311667072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (7524us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480908.434155:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782480908.434175:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782480908.434181:0:14877:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869066311667328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782480908.434193:0:14877:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480908.434244:0:14877:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1869066311667328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (4940us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480908.434251:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:3.0:1782480908.434273:0:14262:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:1.0:1782480908.434338:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f2d7100 x1869066311667328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480908.434359:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311667328:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1782480908.434569:0:14262:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 529275820703ns, next at 0ns, rc = 0 00010000:00080000:3.0:1782480908.434926:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d7f2d6300 x1869066311667072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480908.434952:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311667072:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1782480908.435287:0:14876:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1782480908.435294:0:14876:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1782480908.435300:0:14876:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:2.0:1782480908.454417:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.454429:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c024c34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.454444:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.454449:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.454455:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c024c34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.454471:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c024c34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.454492:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c024c34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.454500:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c024c34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.454530:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782480908.455200:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.455209:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c024c34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.455220:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9400 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.455224:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c024c34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.455234:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c024c34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.455254:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c024c34 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.455262:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c024c34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.455355:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.455358:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.455361:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.456335:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.456344:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c3b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.456356:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.456359:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.456364:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.456375:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.456385:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.456392:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.456421:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782480908.456432:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480908.456436:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.456443:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9e00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480908.456447:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.456454:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.456466:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c3b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.456473:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.456485:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.456486:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.456487:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.460538:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.462680:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e236ec6/0x3dc3ebf33c024c42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.462707:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.462719:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.462728:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e236ec6/0x3dc3ebf33c024c42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.462773:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e236ec6/0x3dc3ebf33c024c42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.462787:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e236ec6/0x3dc3ebf33c024c42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.462796:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e236ec6/0x3dc3ebf33c024c42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.462814:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782480908.465689:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.465705:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e236ec6/0x3dc3ebf33c024c42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.466462:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8200 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.467730:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e236ec6/0x3dc3ebf33c024c42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.467761:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e236ec6/0x3dc3ebf33c024c42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.469504:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e236ec6/0x3dc3ebf33c024c42 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.469517:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e236ec6/0x3dc3ebf33c024c42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.469548:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.469550:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.469699:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.471030:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.471159:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024c49 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.471305:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.471311:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.471317:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024c49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.471405:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024c49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.471417:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024c49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.471433:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024c49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.471461:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782480908.471506:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.471514:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024c49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.471525:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9c00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.471530:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024c49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.471540:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024c49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.471565:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024c49 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.471573:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024c49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.471593:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.471595:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.471597:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.473294:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.473305:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb969147/0x3dc3ebf33c024c50 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.473457:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.473463:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.473546:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb969147/0x3dc3ebf33c024c50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.473646:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb969147/0x3dc3ebf33c024c50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.473657:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb969147/0x3dc3ebf33c024c50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.473666:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb969147/0x3dc3ebf33c024c50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.473688:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782480908.473700:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480908.473705:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb969147/0x3dc3ebf33c024c50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.473720:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9200 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480908.473725:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb969147/0x3dc3ebf33c024c50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.473735:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb969147/0x3dc3ebf33c024c50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.473896:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb969147/0x3dc3ebf33c024c50 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.473905:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb969147/0x3dc3ebf33c024c50 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.473926:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.473928:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.473930:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.474539:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.474546:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024c57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.474570:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.474574:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.474579:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024c57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.474589:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024c57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.474606:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024c57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.474613:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024c57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.474637:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782480908.474853:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480908.474861:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024c57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.474872:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8400 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:3.0:1782480908.474877:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024c57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.474887:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024c57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.474904:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024c57 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.474912:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024c57 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.474930:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480908.474932:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480908.474933:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.475395:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.475403:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024c5e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.475412:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.475415:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.475419:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024c5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.475428:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024c5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.475435:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024c5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.475442:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024c5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.475475:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782480908.475541:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.475550:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024c5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.475559:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8000 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.475564:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024c5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.475574:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024c5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.475589:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024c5e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.475598:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024c5e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.475633:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.475636:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.475638:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.475950:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.475956:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024c65 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.475965:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.475968:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.475972:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024c65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.475982:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024c65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.475990:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024c65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.475998:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024c65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.476027:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782480908.476038:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480908.476043:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024c65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.476061:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8a00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480908.476071:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024c65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.476080:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024c65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.476092:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024c65 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.476100:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024c65 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.476118:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.476120:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.476122:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.476588:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.476595:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024c6c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.476603:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.476607:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.476611:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024c6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.476621:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024c6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.476630:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024c6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782480908.476638:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1782480908.476643:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024c6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.476660:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782480908.476671:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480908.476675:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024c6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.476681:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9000 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480908.476685:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024c6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.476693:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024c6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.476705:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024c6c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.476713:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024c6c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.476730:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.476732:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.476734:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.477264:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.477277:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5896128/0x3dc3ebf33c024c73 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.477286:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.477289:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.477293:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5896128/0x3dc3ebf33c024c73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.477302:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5896128/0x3dc3ebf33c024c73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.477312:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5896128/0x3dc3ebf33c024c73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.477318:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5896128/0x3dc3ebf33c024c73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.477333:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782480908.477341:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480908.477345:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5896128/0x3dc3ebf33c024c73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.477351:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9600 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480908.477355:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5896128/0x3dc3ebf33c024c73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.477362:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5896128/0x3dc3ebf33c024c73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.477379:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5896128/0x3dc3ebf33c024c73 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.477387:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5896128/0x3dc3ebf33c024c73 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.477399:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.477401:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.477403:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.477859:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.477866:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c7a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.477875:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.477878:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.477883:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.477892:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.477901:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.477909:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.477936:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782480908.477947:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480908.477951:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.477958:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9e00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480908.477961:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.477968:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.477978:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c7a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.477985:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c7a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.477997:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.477999:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.478862:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.480723:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.480737:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092d0c76d/0x3dc3ebf33c024c81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.481030:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.481041:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.481116:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092d0c76d/0x3dc3ebf33c024c81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.481131:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092d0c76d/0x3dc3ebf33c024c81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.481142:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092d0c76d/0x3dc3ebf33c024c81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.481149:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092d0c76d/0x3dc3ebf33c024c81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.481167:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782480908.481308:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480908.481317:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092d0c76d/0x3dc3ebf33c024c81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.481398:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9800 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480908.481404:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d0c76d/0x3dc3ebf33c024c81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.481413:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d0c76d/0x3dc3ebf33c024c81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.481432:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092d0c76d/0x3dc3ebf33c024c81 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.481452:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092d0c76d/0x3dc3ebf33c024c81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.481477:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.481479:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.481481:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.482643:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.482655:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c024c88 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.482667:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.482671:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.482675:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c024c88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.482687:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c024c88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.482697:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c024c88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.482704:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c024c88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.482729:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782480908.483858:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.483873:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c8f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.483886:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.483889:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.483893:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.483904:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.483913:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.483921:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.483945:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782480908.484128:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782480908.484137:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c024c88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.484147:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9400 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:0.0:1782480908.484153:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c024c88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.484176:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c024c88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.484195:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c024c88 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.484203:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000816a024d/0x3dc3ebf33c024c88 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.484223:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480908.484226:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.484233:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9e00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:0.0:1782480908.484236:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.484244:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.484253:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c8f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.484259:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006377b583/0x3dc3ebf33c024c8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.484287:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480908.484291:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480908.484293:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.484896:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.484904:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5896128/0x3dc3ebf33c024c96 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.484914:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.484917:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.484921:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5896128/0x3dc3ebf33c024c96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.484930:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5896128/0x3dc3ebf33c024c96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.484946:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5896128/0x3dc3ebf33c024c96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.484952:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5896128/0x3dc3ebf33c024c96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.484964:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782480908.485086:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480908.485091:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5896128/0x3dc3ebf33c024c96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.485100:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9600 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:0.0:1782480908.485104:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5896128/0x3dc3ebf33c024c96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.485112:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5896128/0x3dc3ebf33c024c96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.485123:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5896128/0x3dc3ebf33c024c96 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.485130:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5896128/0x3dc3ebf33c024c96 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.485146:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480908.485148:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480908.485149:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480908.485994:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.486351:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.486359:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024c9d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.486371:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.486374:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.486378:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024c9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.486388:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024c9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.486397:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024c9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.486404:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024c9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.486439:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782480908.486475:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480908.486483:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024c9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.486512:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9000 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:0.0:1782480908.486517:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024c9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.486526:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024c9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.486542:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024c9d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.486550:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024c9d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.486568:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480908.486570:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480908.486572:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.487297:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.487305:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024ca4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.487315:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.487318:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.487322:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024ca4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.487331:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024ca4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.487339:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024ca4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.487346:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024ca4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.487362:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782480908.487371:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480908.487375:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024ca4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.487381:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8a00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480908.487390:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024ca4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.487398:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024ca4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.487410:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024ca4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.487416:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024ca4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.487431:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.487432:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.487434:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.488418:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.488427:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb969147/0x3dc3ebf33c024cab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.488439:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.488443:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.488447:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb969147/0x3dc3ebf33c024cab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.488459:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb969147/0x3dc3ebf33c024cab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.488467:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb969147/0x3dc3ebf33c024cab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.488482:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb969147/0x3dc3ebf33c024cab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.488501:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1782480908.489828:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.489838:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024cb2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.489849:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.489852:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.489857:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024cb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.489868:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024cb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.489877:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024cb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.489885:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024cb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.489907:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1782480908.489925:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782480908.489932:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb969147/0x3dc3ebf33c024cab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.489947:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9200 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480908.489952:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb969147/0x3dc3ebf33c024cab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.489962:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb969147/0x3dc3ebf33c024cab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.489982:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb969147/0x3dc3ebf33c024cab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.489990:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb969147/0x3dc3ebf33c024cab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.490021:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480908.490024:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024cb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.490031:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8000 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480908.490034:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024cb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.490042:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024cb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.490063:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024cb2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.490077:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024cb2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.490091:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.490093:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.490095:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.490979:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.490988:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024cb9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.490998:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.491001:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.491005:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024cb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.491027:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024cb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.491035:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024cb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.491108:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024cb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.491129:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782480908.491139:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480908.491149:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024cb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.491156:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9c00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480908.491160:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024cb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.491168:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024cb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.491180:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024cb9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.491187:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024cb9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.491274:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.491277:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.491278:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480908.493267:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.493470:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.493481:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e236ec6/0x3dc3ebf33c024cc0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.493494:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.493498:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.493502:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e236ec6/0x3dc3ebf33c024cc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.493526:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e236ec6/0x3dc3ebf33c024cc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.493536:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e236ec6/0x3dc3ebf33c024cc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.493543:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e236ec6/0x3dc3ebf33c024cc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.496104:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782480908.496129:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.496139:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e236ec6/0x3dc3ebf33c024cc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.496155:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8200 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.496171:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e236ec6/0x3dc3ebf33c024cc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.496184:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e236ec6/0x3dc3ebf33c024cc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.496204:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e236ec6/0x3dc3ebf33c024cc0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.496212:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e236ec6/0x3dc3ebf33c024cc0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.496234:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.496236:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.496237:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.496846:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.496856:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092d0c76d/0x3dc3ebf33c024cc7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.496870:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.496874:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.496881:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092d0c76d/0x3dc3ebf33c024cc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.496894:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092d0c76d/0x3dc3ebf33c024cc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.496903:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092d0c76d/0x3dc3ebf33c024cc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.496921:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092d0c76d/0x3dc3ebf33c024cc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.496936:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782480908.497941:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.497949:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092d0c76d/0x3dc3ebf33c024cc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.497971:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9800 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.497976:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d0c76d/0x3dc3ebf33c024cc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.497985:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d0c76d/0x3dc3ebf33c024cc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.498001:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092d0c76d/0x3dc3ebf33c024cc7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.498019:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092d0c76d/0x3dc3ebf33c024cc7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.498043:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.498045:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.498048:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.498602:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.498611:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024cce lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.498623:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.498627:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.498632:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024cce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.498644:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024cce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.498653:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024cce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.498663:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024cce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.498688:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782480908.499080:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.499087:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024cce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.499096:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8400 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.499100:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024cce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.499108:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024cce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.499131:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024cce lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.499138:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7cf1084/0x3dc3ebf33c024cce lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.499155:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.499230:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.499232:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.500148:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.500157:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024cd5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.500178:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.500181:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.500186:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024cd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.500398:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024cd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.500409:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024cd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.500417:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024cd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.500432:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782480908.500637:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.500644:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024cd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.500653:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8a00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.500657:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024cd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.500665:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024cd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.500682:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024cd5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.500691:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b853278/0x3dc3ebf33c024cd5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.500725:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.500768:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.500771:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.509531:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.509547:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024cdc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.509899:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.509904:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.509911:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024cdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.509927:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024cdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.509951:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024cdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.509959:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024cdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.509981:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782480908.509999:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480908.510005:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024cdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.510026:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9000 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480908.510031:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024cdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.510040:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024cdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.510663:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024cdc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.510672:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024cdc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.510805:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.510816:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.510820:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.512973:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.512988:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024ce3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.513003:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.513018:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.513024:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024ce3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.513039:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024ce3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.513641:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024ce3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.513650:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024ce3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.513673:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782480908.514033:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.514042:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024ce3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.514052:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9c00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.514056:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024ce3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.514065:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024ce3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.514083:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024ce3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.514089:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036492366/0x3dc3ebf33c024ce3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.514109:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.514110:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.514112:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.516643:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.516657:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024cea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.516676:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.517137:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.517144:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024cea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.517171:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024cea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.517182:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024cea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.517190:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024cea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.517282:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782480908.517346:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.517354:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024cea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.517377:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9000 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.517381:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024cea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.517404:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024cea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.517422:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024cea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.517430:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d725a188/0x3dc3ebf33c024cea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.517450:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.517452:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.517455:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1782480908.520739:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480908.520778:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024cf1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.520907:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1782480908.520914:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480908.520921:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024cf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.520939:0:14876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024cf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.520950:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024cf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.520971:0:14876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024cf1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.521077:0:14876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1782480908.521328:0:14876:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:2.0:1782480908.521420:0:14876:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14261:x1869066311667200:12345-0@lo:5:osp-pre-0-0.0 Request processed in 92021us (93284us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480908.521431:0:14876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782480908.521503:0:14261:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14261:1869066311667200:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1782480908.521517:0:14261:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1782480908.521563:0:14261:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14261:1869066311667584:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1782480908.521598:0:14261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480908.521639:0:14261:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7b17cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1782480908.521655:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311667584 00000100:00100000:2.0:1782480908.521661:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311667584 00000100:00100000:2.0:1782480908.521696:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782480908.521705:0:14873:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14263:x1869066311667456:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1782480908.521871:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1782480908.523170:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.523181:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024cf1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.523194:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8000 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.523199:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024cf1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.523210:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024cf1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.523238:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024cf1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.523246:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053be4419/0x3dc3ebf33c024cf1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.523267:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.523269:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.523271:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1782480908.525339:0:14873:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1782480908.525350:0:14873:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1782480908.525356:0:14873:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1782480908.537881:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782480908.537894:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd024951/0x3dc3ebf33c024cf8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.537927:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1782480908.537932:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480908.537939:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd024951/0x3dc3ebf33c024cf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.537956:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd024951/0x3dc3ebf33c024cf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.537967:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd024951/0x3dc3ebf33c024cf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.537975:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd024951/0x3dc3ebf33c024cf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.537999:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782480908.538488:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782480908.538706:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096d583ae/0x3dc3ebf33c024cff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.538716:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1782480908.538719:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480908.538724:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096d583ae/0x3dc3ebf33c024cff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.538735:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096d583ae/0x3dc3ebf33c024cff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.538776:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096d583ae/0x3dc3ebf33c024cff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.538783:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096d583ae/0x3dc3ebf33c024cff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.538861:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782480908.539151:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782480908.539160:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd024951/0x3dc3ebf33c024cf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.539171:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1fe00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:0.0:1782480908.539176:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd024951/0x3dc3ebf33c024cf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.539199:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd024951/0x3dc3ebf33c024cf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.539221:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd024951/0x3dc3ebf33c024cf8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.539229:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd024951/0x3dc3ebf33c024cf8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.539251:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480908.539255:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096d583ae/0x3dc3ebf33c024cff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.539262:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1f800 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:0.0:1782480908.539266:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096d583ae/0x3dc3ebf33c024cff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.539279:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096d583ae/0x3dc3ebf33c024cff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.539288:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096d583ae/0x3dc3ebf33c024cff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.539295:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096d583ae/0x3dc3ebf33c024cff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.539320:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480908.539321:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480908.539323:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782480908.539325:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782480908.539333:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000264c1e65/0x3dc3ebf33c024d06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.539342:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1782480908.539345:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480908.539349:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000264c1e65/0x3dc3ebf33c024d06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.539358:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000264c1e65/0x3dc3ebf33c024d06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.539366:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000264c1e65/0x3dc3ebf33c024d06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.539373:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000264c1e65/0x3dc3ebf33c024d06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.539400:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782480908.539416:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.539423:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000264c1e65/0x3dc3ebf33c024d06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.539432:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1f200 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.539435:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000264c1e65/0x3dc3ebf33c024d06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.539444:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000264c1e65/0x3dc3ebf33c024d06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.539459:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000264c1e65/0x3dc3ebf33c024d06 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.539466:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000264c1e65/0x3dc3ebf33c024d06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.539494:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.539496:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.539498:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.539916:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782480908.540310:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782480908.540317:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc7a8015/0x3dc3ebf33c024d0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.540328:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1782480908.540331:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480908.540336:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc7a8015/0x3dc3ebf33c024d0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.540347:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc7a8015/0x3dc3ebf33c024d0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.540355:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc7a8015/0x3dc3ebf33c024d0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.540363:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc7a8015/0x3dc3ebf33c024d0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.540388:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782480908.540531:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.540538:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc7a8015/0x3dc3ebf33c024d0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.540547:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1ee00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.540551:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc7a8015/0x3dc3ebf33c024d0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.540560:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc7a8015/0x3dc3ebf33c024d0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.540576:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc7a8015/0x3dc3ebf33c024d0d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.540584:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc7a8015/0x3dc3ebf33c024d0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.540601:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.540603:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.540604:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782480908.544467:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782480908.544483:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4fe241d/0x3dc3ebf33c024d14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.544512:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1782480908.544526:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480908.544532:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4fe241d/0x3dc3ebf33c024d14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.544549:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4fe241d/0x3dc3ebf33c024d14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.544560:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4fe241d/0x3dc3ebf33c024d14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.544568:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4fe241d/0x3dc3ebf33c024d14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.544589:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782480908.544603:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480908.544609:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4fe241d/0x3dc3ebf33c024d14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.544617:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1fa00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:3.0:1782480908.544622:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4fe241d/0x3dc3ebf33c024d14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.544631:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4fe241d/0x3dc3ebf33c024d14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.544648:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4fe241d/0x3dc3ebf33c024d14 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.544668:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4fe241d/0x3dc3ebf33c024d14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.544688:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480908.544690:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480908.544692:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782480908.547244:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782480908.547258:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6245d8f/0x3dc3ebf33c024d1b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.547276:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1782480908.547561:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480908.547568:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6245d8f/0x3dc3ebf33c024d1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.547585:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6245d8f/0x3dc3ebf33c024d1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.547595:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6245d8f/0x3dc3ebf33c024d1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.547604:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6245d8f/0x3dc3ebf33c024d1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.547681:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782480908.548257:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782480908.548270:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e374fd6/0x3dc3ebf33c024d22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.548294:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1782480908.548297:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480908.548302:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e374fd6/0x3dc3ebf33c024d22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.548313:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e374fd6/0x3dc3ebf33c024d22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.548321:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e374fd6/0x3dc3ebf33c024d22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.548330:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e374fd6/0x3dc3ebf33c024d22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.549244:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782480908.549257:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6245d8f/0x3dc3ebf33c024d1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.549285:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1fc00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.549290:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6245d8f/0x3dc3ebf33c024d1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.549300:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6245d8f/0x3dc3ebf33c024d1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.549322:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6245d8f/0x3dc3ebf33c024d1b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.549330:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6245d8f/0x3dc3ebf33c024d1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.549352:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.549356:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e374fd6/0x3dc3ebf33c024d22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.549363:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1e000 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.549367:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e374fd6/0x3dc3ebf33c024d22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.549375:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e374fd6/0x3dc3ebf33c024d22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.549384:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e374fd6/0x3dc3ebf33c024d22 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.549398:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.549400:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.549402:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480908.549585:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1782480908.549592:0:14873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e374fd6/0x3dc3ebf33c024d22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782480908.550440:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782480908.550450:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd603a1b/0x3dc3ebf33c024d29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.550463:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1782480908.550468:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480908.550482:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd603a1b/0x3dc3ebf33c024d29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.550558:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd603a1b/0x3dc3ebf33c024d29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.550568:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd603a1b/0x3dc3ebf33c024d29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.550576:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd603a1b/0x3dc3ebf33c024d29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.550761:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.550767:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd603a1b/0x3dc3ebf33c024d29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.550776:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1ec00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.550780:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd603a1b/0x3dc3ebf33c024d29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.550788:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd603a1b/0x3dc3ebf33c024d29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.550813:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd603a1b/0x3dc3ebf33c024d29 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.550821:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.550822:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.550824:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480908.550969:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1782480908.550974:0:14873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd603a1b/0x3dc3ebf33c024d29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782480908.552548:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782480908.552560:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c024d30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.552573:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1782480908.552577:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480908.552583:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c024d30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.552596:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c024d30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.552619:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c024d30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.552627:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c024d30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.553211:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.553219:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c024d30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.553228:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1e800 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.553232:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c024d30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.553249:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c024d30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.553266:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c024d30 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.553593:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1782480908.553610:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.553964:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c024d30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.553991:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.553993:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.553995:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782480908.554708:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782480908.554716:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d9c24a9/0x3dc3ebf33c024d37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.554728:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1782480908.554732:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480908.554737:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d9c24a9/0x3dc3ebf33c024d37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.554910:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d9c24a9/0x3dc3ebf33c024d37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.554920:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d9c24a9/0x3dc3ebf33c024d37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.554928:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d9c24a9/0x3dc3ebf33c024d37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.554960:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782480908.555579:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480908.555587:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d9c24a9/0x3dc3ebf33c024d37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.555611:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1e600 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480908.555615:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d9c24a9/0x3dc3ebf33c024d37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.555625:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d9c24a9/0x3dc3ebf33c024d37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.555643:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d9c24a9/0x3dc3ebf33c024d37 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.555651:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d9c24a9/0x3dc3ebf33c024d37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.555672:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.555674:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480908.555675:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782480908.555924:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782480908.555932:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd4fd20a/0x3dc3ebf33c024d3e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.555941:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1782480908.555944:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480908.555949:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd4fd20a/0x3dc3ebf33c024d3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.555960:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd4fd20a/0x3dc3ebf33c024d3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.555968:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd4fd20a/0x3dc3ebf33c024d3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.555976:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd4fd20a/0x3dc3ebf33c024d3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.556036:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782480908.556685:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782480908.556693:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ed05f48/0x3dc3ebf33c024d45 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.556702:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1782480908.556711:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480908.556716:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ed05f48/0x3dc3ebf33c024d45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.556726:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ed05f48/0x3dc3ebf33c024d45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.556733:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ed05f48/0x3dc3ebf33c024d45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.556740:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ed05f48/0x3dc3ebf33c024d45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.557028:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782480908.557036:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd4fd20a/0x3dc3ebf33c024d3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.557044:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1ea00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.557047:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd4fd20a/0x3dc3ebf33c024d3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.557056:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd4fd20a/0x3dc3ebf33c024d3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.557071:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd4fd20a/0x3dc3ebf33c024d3e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.557091:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd4fd20a/0x3dc3ebf33c024d3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.557110:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.557113:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ed05f48/0x3dc3ebf33c024d45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.557119:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1e200 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.557123:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ed05f48/0x3dc3ebf33c024d45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.557131:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ed05f48/0x3dc3ebf33c024d45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.557141:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ed05f48/0x3dc3ebf33c024d45 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.557147:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.557149:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.557150:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480908.557190:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1782480908.557197:0:14873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ed05f48/0x3dc3ebf33c024d45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.557250:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782480908.557996:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782480908.558004:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e28ed59/0x3dc3ebf33c024d4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.558024:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1782480908.558029:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480908.558033:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e28ed59/0x3dc3ebf33c024d4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.558044:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e28ed59/0x3dc3ebf33c024d4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.558061:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e28ed59/0x3dc3ebf33c024d4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.558068:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e28ed59/0x3dc3ebf33c024d4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.558121:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782480908.558643:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782480908.558650:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebb42909/0x3dc3ebf33c024d53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.558660:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1782480908.558662:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480908.558667:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebb42909/0x3dc3ebf33c024d53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.558677:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebb42909/0x3dc3ebf33c024d53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.558685:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ebb42909/0x3dc3ebf33c024d53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.558692:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ebb42909/0x3dc3ebf33c024d53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.559365:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782480908.559376:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e28ed59/0x3dc3ebf33c024d4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.559386:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1f000 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.559397:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e28ed59/0x3dc3ebf33c024d4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.559406:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e28ed59/0x3dc3ebf33c024d4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.559423:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e28ed59/0x3dc3ebf33c024d4c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.559430:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e28ed59/0x3dc3ebf33c024d4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.559449:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.559453:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ebb42909/0x3dc3ebf33c024d53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.559459:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1e400 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.559463:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebb42909/0x3dc3ebf33c024d53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.559470:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ebb42909/0x3dc3ebf33c024d53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.559480:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ebb42909/0x3dc3ebf33c024d53 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.559488:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.559508:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.559510:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480908.559611:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1782480908.559618:0:14873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebb42909/0x3dc3ebf33c024d53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.559797:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782480908.561109:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782480908.561118:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2e24077/0x3dc3ebf33c024d5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.561133:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1782480908.561137:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480908.561142:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2e24077/0x3dc3ebf33c024d5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.561156:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2e24077/0x3dc3ebf33c024d5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.561166:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2e24077/0x3dc3ebf33c024d5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.561174:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2e24077/0x3dc3ebf33c024d5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.561240:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782480908.561677:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782480908.561683:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8478058/0x3dc3ebf33c024d61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.561702:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1782480908.561705:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480908.561709:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8478058/0x3dc3ebf33c024d61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.561718:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8478058/0x3dc3ebf33c024d61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.561727:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8478058/0x3dc3ebf33c024d61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.561734:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8478058/0x3dc3ebf33c024d61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.565166:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782480908.565182:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2e24077/0x3dc3ebf33c024d5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.565197:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2ce00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.565202:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2e24077/0x3dc3ebf33c024d5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.565213:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2e24077/0x3dc3ebf33c024d5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.565233:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2e24077/0x3dc3ebf33c024d5a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.565239:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2e24077/0x3dc3ebf33c024d5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.565262:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.565265:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8478058/0x3dc3ebf33c024d61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.565271:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2d000 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.565274:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8478058/0x3dc3ebf33c024d61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.565302:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8478058/0x3dc3ebf33c024d61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.565312:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8478058/0x3dc3ebf33c024d61 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.565320:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.565321:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.565323:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480908.569310:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782480908.569328:0:14873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8478058/0x3dc3ebf33c024d61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.569360:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782480908.570191:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782480908.570199:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c024d68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.570228:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1782480908.570232:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480908.570238:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c024d68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.570265:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c024d68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.570276:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c024d68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.570283:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c024d68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.570300:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782480908.570553:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.570560:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c024d68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.570568:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2d200 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.570573:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c024d68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.570582:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c024d68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.570601:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c024d68 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.570608:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c024d68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.570638:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.570640:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.570641:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782480908.571234:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782480908.571242:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f86b899f/0x3dc3ebf33c024d6f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.571252:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1782480908.571256:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480908.571260:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f86b899f/0x3dc3ebf33c024d6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.571269:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f86b899f/0x3dc3ebf33c024d6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.571276:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f86b899f/0x3dc3ebf33c024d6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.571295:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f86b899f/0x3dc3ebf33c024d6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.571318:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782480908.571372:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480908.571379:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f86b899f/0x3dc3ebf33c024d6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.571390:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c800 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:3.0:1782480908.571394:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f86b899f/0x3dc3ebf33c024d6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.571404:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f86b899f/0x3dc3ebf33c024d6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.571418:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f86b899f/0x3dc3ebf33c024d6f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.571426:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f86b899f/0x3dc3ebf33c024d6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.571455:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480908.571457:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480908.571458:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782480908.572532:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782480908.572539:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004dfaece/0x3dc3ebf33c024d76 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.572550:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1782480908.572553:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480908.572556:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004dfaece/0x3dc3ebf33c024d76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.572564:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004dfaece/0x3dc3ebf33c024d76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.572572:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004dfaece/0x3dc3ebf33c024d76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.572579:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004dfaece/0x3dc3ebf33c024d76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.572636:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782480908.573113:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782480908.573119:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024d7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.573133:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1782480908.573136:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480908.573141:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024d7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.573151:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024d7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.573159:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024d7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.573166:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024d7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.574586:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782480908.574599:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004dfaece/0x3dc3ebf33c024d76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.574611:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2d600 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.574615:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004dfaece/0x3dc3ebf33c024d76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.574624:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004dfaece/0x3dc3ebf33c024d76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.574643:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004dfaece/0x3dc3ebf33c024d76 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.574651:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004dfaece/0x3dc3ebf33c024d76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.574670:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.574674:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024d7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.574681:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2da00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.574697:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024d7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.574706:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024d7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.574717:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024d7d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.574725:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.574727:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.574729:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480908.575047:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782480908.575055:0:14873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1e479c0/0x3dc3ebf33c024d7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.575549:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782480908.575724:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782480908.575731:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d58c7789/0x3dc3ebf33c024d84 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.575743:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1782480908.575859:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480908.575866:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d58c7789/0x3dc3ebf33c024d84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.575890:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d58c7789/0x3dc3ebf33c024d84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.575900:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d58c7789/0x3dc3ebf33c024d84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.575908:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d58c7789/0x3dc3ebf33c024d84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.575958:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782480908.576366:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782480908.576371:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c024d8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.576380:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1782480908.576383:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480908.576387:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c024d8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.576396:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c024d8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.576403:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c024d8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.576421:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c024d8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.576530:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782480908.576537:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d58c7789/0x3dc3ebf33c024d84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.576544:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2dc00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.576548:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d58c7789/0x3dc3ebf33c024d84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.576556:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d58c7789/0x3dc3ebf33c024d84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.576569:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d58c7789/0x3dc3ebf33c024d84 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.576576:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d58c7789/0x3dc3ebf33c024d84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.576597:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.576600:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c024d8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.576605:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c600 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.576608:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c024d8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.576615:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c024d8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.576622:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c024d8b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.576628:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.576629:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.576631:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480908.576697:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782480908.576703:0:14873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c024d8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782480908.577174:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782480908.577181:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032fcbad8/0x3dc3ebf33c024d92 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.577190:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1782480908.577193:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480908.577197:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032fcbad8/0x3dc3ebf33c024d92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.577207:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032fcbad8/0x3dc3ebf33c024d92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.577215:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032fcbad8/0x3dc3ebf33c024d92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.577222:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032fcbad8/0x3dc3ebf33c024d92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.578244:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480908.578254:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032fcbad8/0x3dc3ebf33c024d92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.578263:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c400 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480908.578267:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032fcbad8/0x3dc3ebf33c024d92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.578389:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032fcbad8/0x3dc3ebf33c024d92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.578407:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032fcbad8/0x3dc3ebf33c024d92 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.578534:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480908.578537:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480908.578539:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480908.578617:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782480908.578624:0:14873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032fcbad8/0x3dc3ebf33c024d92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782480908.579248:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782480908.579254:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc7e41c8/0x3dc3ebf33c024d99 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.579265:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1782480908.579269:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480908.579431:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc7e41c8/0x3dc3ebf33c024d99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.579511:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc7e41c8/0x3dc3ebf33c024d99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.579522:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc7e41c8/0x3dc3ebf33c024d99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.579530:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc7e41c8/0x3dc3ebf33c024d99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.579582:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.579589:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc7e41c8/0x3dc3ebf33c024d99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.579595:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d413f5200 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.579599:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc7e41c8/0x3dc3ebf33c024d99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.579619:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc7e41c8/0x3dc3ebf33c024d99 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.579632:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc7e41c8/0x3dc3ebf33c024d99 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.579640:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.579642:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.579644:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480908.579713:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782480908.579719:0:14873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc7e41c8/0x3dc3ebf33c024d99 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782480908.580229:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782480908.580235:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0ffb099/0x3dc3ebf33c024da0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.580247:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1782480908.580251:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480908.580255:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0ffb099/0x3dc3ebf33c024da0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.580265:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0ffb099/0x3dc3ebf33c024da0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.580387:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0ffb099/0x3dc3ebf33c024da0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.580395:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0ffb099/0x3dc3ebf33c024da0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.580546:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480908.580552:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0ffb099/0x3dc3ebf33c024da0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.580560:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d413f4e00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:3.0:1782480908.580564:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0ffb099/0x3dc3ebf33c024da0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.580572:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0ffb099/0x3dc3ebf33c024da0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.580585:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0ffb099/0x3dc3ebf33c024da0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.580593:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480908.580595:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480908.580596:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480908.580661:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782480908.580667:0:14873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0ffb099/0x3dc3ebf33c024da0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782480908.581178:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782480908.581186:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002115925a/0x3dc3ebf33c024da7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.581208:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1782480908.581211:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480908.581216:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002115925a/0x3dc3ebf33c024da7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.581227:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002115925a/0x3dc3ebf33c024da7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.581237:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002115925a/0x3dc3ebf33c024da7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.581244:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002115925a/0x3dc3ebf33c024da7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.581549:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.581555:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002115925a/0x3dc3ebf33c024da7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.581564:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d413f5c00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.581568:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002115925a/0x3dc3ebf33c024da7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.581577:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002115925a/0x3dc3ebf33c024da7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.581589:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002115925a/0x3dc3ebf33c024da7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.581597:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.581599:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.581600:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480908.581686:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1782480908.581691:0:14873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002115925a/0x3dc3ebf33c024da7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.583409:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782480908.583603:0:14873:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782480908.583615:0:14873:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020dc84e9/0x3dc3ebf33c024dae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.583630:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1782480908.583635:0:14873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480908.583640:0:14873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020dc84e9/0x3dc3ebf33c024dae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.583673:0:14873:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020dc84e9/0x3dc3ebf33c024dae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.583685:0:14873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020dc84e9/0x3dc3ebf33c024dae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.583692:0:14873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020dc84e9/0x3dc3ebf33c024dae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.583713:0:14873:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1782480908.584059:0:14873:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1782480908.584164:0:14873:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14263:x1869066311667456:12345-0@lo:5:osp-pre-1-0.0 Request processed in 62455us (154954us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480908.584174:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782480908.584206:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782480908.584217:0:14873:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14261:x1869066311667584:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1782480908.584257:0:14873:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:1.0:1782480908.586156:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480908.586167:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020dc84e9/0x3dc3ebf33c024dae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.586180:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d413f5a00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480908.586185:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020dc84e9/0x3dc3ebf33c024dae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.586196:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020dc84e9/0x3dc3ebf33c024dae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.586218:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020dc84e9/0x3dc3ebf33c024dae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.586225:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020dc84e9/0x3dc3ebf33c024dae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.586247:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.586249:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480908.586250:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480908.586580:0:14263:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14263:1869066311667456:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1782480908.586596:0:14263:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1782480908.586646:0:14263:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14263:1869066311667712:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1782480908.586705:0:14263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480908.586853:0:14263:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d45f6e180 going to sleep for 11 seconds 00000100:00100000:1.0:1782480908.587094:0:14874:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1782480908.587102:0:14874:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1782480908.591703:0:14873:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14261:x1869066311667584:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7481us (70095us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1782480908.591719:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782480908.591828:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311667712 00000100:00100000:0.0:1782480908.591836:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311667712 00000100:00100000:2.0:1782480908.591999:0:14261:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14261:1869066311667584:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1782480908.592028:0:14261:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:0.0:1782480908.592093:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782480908.592104:0:14873:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14263:x1869066311667712:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1782480908.592148:0:14873:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1782480908.598136:0:14873:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14263:x1869066311667712:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6026us (11422us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1782480908.598150:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782480908.598226:0:14263:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14263:1869066311667712:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1782480908.598247:0:14263:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1782480908.601394:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782480908.601909:0:14235:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782480908.601915:0:14235:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9b6d52754000 from 8 10000000:01000000:0.0:1782480908.601919:0:14235:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782480908.601974:0:14235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c024db5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.601986:0:14235:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c024db5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.601996:0:14235:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c024db5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480908.602036:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311667840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782480908.602110:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480908.602201:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae5d780 going to sleep for 11 seconds 00000100:00100000:3.0:1782480908.603053:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311667840 00000100:00100000:3.0:1782480908.603063:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311667840 00000100:00100000:3.0:1782480908.603177:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782480908.603188:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+18:14235:x1869066311667840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480908.603202:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480908.603221:0:14232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d6ef1e400/0x3dc3ebf33c024dbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c024db5 expref: -99 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.603247:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d6ef1e400/0x3dc3ebf33c024dbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c024db5 expref: 19 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.603257:0:14232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d6ef1e400/0x3dc3ebf33c024dbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024db5 expref: 19 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.603265:0:14232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6ef1e400, rc 0) 00000100:00100000:3.0:1782480908.603391:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:14235:x1869066311667840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480908.603399:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1782480908.603481:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311667840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782480908.603498:0:14235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c024db5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024dbc expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.603507:0:14235:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c024db5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c024dbc expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480908.603575:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311667968:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1782480908.603626:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480908.603849:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae5d780 going to sleep for 11 seconds 00000100:00100000:1.0:1782480908.603954:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311667968 00000100:00100000:1.0:1782480908.603960:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311667968 00000100:00100000:1.0:1782480908.603987:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782480908.603994:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:14235:x1869066311667968:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1782480908.604024:0:14233:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782480908.604042:0:14233:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782480908.604049:0:14233:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1782480908.604136:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:14235:x1869066311667968:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 142us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480908.604144:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782480908.604227:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311667968:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782480908.604367:0:14235:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782480908.604376:0:14235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c024db5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024dbc expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.604385:0:14235:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d413f5c00/0x3dc3ebf33c024db5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024dbc expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.622910:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782480910.162104:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1782480910.162126:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1782480910.653219:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480911.681923:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480912.697588:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782480912.767891:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1782480912.767937:0:7497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1782480913.656345:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311668096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480913.656606:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480913.656705:0:14878:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311668096 00000100:00100000:3.0:1782480913.656713:0:14878:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311668096 00000100:00100000:3.0:1782480913.656809:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782480913.656827:0:14878:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311668096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782480913.656865:0:14878:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480913.656920:0:14878:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311668096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480913.656927:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1782480913.656948:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782480913.657473:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3315:1869066311668224:0@lo:400:kworker.0 00000100:00100000:1.0:1782480913.657517:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480913.657556:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311668736:0@lo:400:kworker.0 00000100:00100000:3.0:1782480913.657562:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311668352:0@lo:400:kworker.0 00000100:00100000:1.0:1782480913.657591:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480913.657606:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480913.657634:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311668864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480913.657646:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311668736 00000100:00100000:1.0:1782480913.657652:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311668736 00000100:00100000:3.0:1782480913.657659:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480913.657678:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311668224 00000100:00100000:0.0:1782480913.657685:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311668224 00000100:00100000:1.0:1782480913.657704:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782480913.657717:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311668736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480913.657728:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782480913.657740:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:3315:x1869066311668224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480913.657828:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:3315:x1869066311668224:12345-0@lo:400:kworker.0 Request processed in 91us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480913.657836:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782480913.657885:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3315:1869066311668224:0@lo:400:kworker.0 00000100:00100000:3.0:1782480913.658077:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869066311668480:0@lo:400:kworker.0 00000100:00100000:3.0:1782480913.658159:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480913.658181:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782480913.658188:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311668608:0@lo:400:kworker.0 00000100:00100000:3.0:1782480913.658211:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480913.658230:0:14878:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311668864 00000100:00100000:3.0:1782480913.658267:0:14878:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311668864 00000100:00100000:3.0:1782480913.658295:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782480913.658301:0:14878:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311668864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480913.658325:0:14878:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480913.658388:0:14878:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311668864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480913.658395:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782480913.658638:0:14239:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1782480913.658645:0:14239:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1782480913.658797:0:14239:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311668480 00000100:00100000:0.0:1782480913.658801:0:14239:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311668480 00000100:00100000:0.0:1782480913.658819:0:14239:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1782480913.658825:0:14239:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311668608 00000100:00100000:0.0:1782480913.658827:0:14239:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311668608 00000100:00100000:0.0:1782480913.658842:0:14239:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1782480913.658849:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782480913.658854:0:14239:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869066311668480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480913.658895:0:14239:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1869066311668480:12345-0@lo:400:kworker.0 Request processed in 40us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480913.658920:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782480913.658934:0:14239:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1782480913.658940:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782480913.658946:0:14239:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311668608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480913.658976:0:14239:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311668608:12345-0@lo:400:kworker.0 Request processed in 30us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480913.658981:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782480913.659062:0:3316:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1782480913.659080:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311668864:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1782480913.659115:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d750fb800 x1869066311668608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480913.659127:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311668608:0@lo:400:kworker.0 00010000:00080000:3.0:1782480913.659136:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d750fa300 x1869066311668480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480913.659144:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3317:1869066311668480:0@lo:400:kworker.0 00000100:00100000:3.0:1782480913.659169:0:3318:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1782480913.659181:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d473d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311668096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480913.659836:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1869066311668736:12345-0@lo:400:kworker.0 Request processed in 2119us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480913.659846:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1782480913.659921:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b6d750f9880 x1869066311668736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782480913.659925:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782480913.659932:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480913.659938:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3315:1869066311668736:0@lo:400:kworker.0 00000100:00100000:2.0:1782480913.660016:0:14876:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311668352 00000100:00100000:2.0:1782480913.660022:0:14876:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311668352 00000100:00100000:2.0:1782480913.660066:0:14876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782480913.660075:0:14876:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311668352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480913.660263:0:14876:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311668352:12345-0@lo:400:kworker.0 Request processed in 190us (2659us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480913.660270:0:14876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782480913.660607:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311668352:0@lo:400:kworker.0 00000001:02000400:2.0:1782480913.676049:0:15900:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782480913.719154:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480914.745300:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782480914.999356:0:14271:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1782480915.705243:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480915.705541:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291749376 00000100:00100000:0.0:1782480915.705551:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291749376 00000100:00100000:0.0:1782480915.705604:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:0.0:1782480915.705612:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2365:x1869066291749376:12345-192.168.204.51@tcp:250:mount.lustre.0 00010000:00080000:0.0:1782480915.705641:0:14231:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 9a33a5c0-4183-4286-a4af-4c77608d8db6@192.168.204.51@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:0.0:1782480915.705668:0:14231:0:(genops.c:1406:class_connect()) connect: client 9a33a5c0-4183-4286-a4af-4c77608d8db6, cookie 0x3dc3ebf33c024dc3 00000100:00080000:0.0:1782480915.705842:0:14231:0:(import.c:65:import_set_state_nolock()) ffff9b6d43a9c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782480915.707024:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+5:2365:x1869066291749376:12345-192.168.204.51@tcp:250:mount.lustre.0 Request processed in 1404us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480915.707035:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:3.0:1782480915.719371:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480915.719528:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291749504 00000100:00100000:0.0:1782480915.719538:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291749504 00000100:00100000:0.0:1782480915.719599:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:0.0:1782480915.719609:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a33a5c0-4183-4286-a4af-4c77608d8db6+5:13725:x1869066291749504:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782480915.719640:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480915.719658:0:14232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d413f5800/0x3dc3ebf33c024dca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fbf7 expref: -99 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480915.719687:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d413f5800/0x3dc3ebf33c024dca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbf7 expref: 6 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480915.719698:0:14232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d413f5800/0x3dc3ebf33c024dca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbf7 expref: 6 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480915.719706:0:14232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d413f5800, rc 0) 00000100:00100000:0.0:1782480915.719798:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a33a5c0-4183-4286-a4af-4c77608d8db6+6:13725:x1869066291749504:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 190us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480915.719804:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:1.0:1782480915.723857:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480915.724203:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291749632 00000100:00100000:0.0:1782480915.724215:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291749632 00000100:00100000:0.0:1782480915.724277:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:0.0:1782480915.724287:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+6:13725:x1869066291749632:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782480915.724954:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+6:13725:x1869066291749632:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 666us (1105us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782480915.724964:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:2.0:1782480915.732950:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480915.733121:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291749760 00000100:00100000:1.0:1782480915.733133:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291749760 00000100:00100000:1.0:1782480915.733202:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:1.0:1782480915.733213:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+6:13725:x1869066291749760:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782480915.733232:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480915.733250:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d6e573800/0x3dc3ebf33c024dd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fbfe expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480915.733296:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d6e573800/0x3dc3ebf33c024dd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbfe expref: 7 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480915.733308:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d6e573800/0x3dc3ebf33c024dd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fbfe expref: 7 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480915.733318:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573800, rc 0) 00000100:00100000:1.0:1782480915.733380:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+7:13725:x1869066291749760:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 169us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480915.733387:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:3.0:1782480915.739825:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480915.739931:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291749888 00000100:00100000:0.0:1782480915.739952:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291749888 00000100:00100000:0.0:1782480915.740010:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:0.0:1782480915.740020:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7585e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+7:13725:x1869066291749888:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782480915.740332:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7585e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+8:13725:x1869066291749888:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 312us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480915.740348:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:0.0:1782480915.742735:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480915.743114:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291750016 00000100:00100000:1.0:1782480915.743125:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291750016 00000100:00100000:1.0:1782480915.743352:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00100000:1.0:1782480915.743363:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+8:13725:x1869066291750016:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782480915.743914:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+8:13725:x1869066291750016:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 550us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480915.743923:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00100000:2.0:1782480915.758399:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480915.758931:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291750144 00000100:00100000:3.0:1782480915.758943:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291750144 00000100:00100000:3.0:1782480915.758995:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:3.0:1782480915.759005:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a33a5c0-4183-4286-a4af-4c77608d8db6+8:13743:x1869066291750144:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782480915.759515:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a33a5c0-4183-4286-a4af-4c77608d8db6+8:13743:x1869066291750144:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 509us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480915.759525:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 82 00010000:00010000:1.0:1782480915.767236:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480915.784804:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480915.784977:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291750272 00000100:00100000:1.0:1782480915.784988:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291750272 00000100:00100000:1.0:1782480915.785042:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 83 00000100:00100000:1.0:1782480915.785052:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+8:13743:x1869066291750272:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782480915.785348:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+8:13743:x1869066291750272:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 296us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480915.785356:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 83 00000100:00100000:1.0:1782480915.801187:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480915.801274:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291750400 00000100:00100000:2.0:1782480915.801285:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291750400 00000100:00100000:2.0:1782480915.801353:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:2.0:1782480915.801364:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+8:13725:x1869066291750400:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782480915.801381:0:14231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480915.801400:0:14231:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d582e8a00/0x3dc3ebf33c024dd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fc28 expref: -99 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480915.801438:0:14231:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d582e8a00/0x3dc3ebf33c024dd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc28 expref: 9 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480915.801449:0:14231:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d582e8a00/0x3dc3ebf33c024dd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc28 expref: 9 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480915.801458:0:14231:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e8a00, rc 0) 00000100:00100000:2.0:1782480915.801510:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+9:13725:x1869066291750400:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 148us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480915.801517:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:2.0:1782480915.805845:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480915.805964:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291750528 00000100:00100000:3.0:1782480915.805974:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291750528 00000100:00100000:3.0:1782480915.806034:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:3.0:1782480915.806045:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a33a5c0-4183-4286-a4af-4c77608d8db6+9:13725:x1869066291750528:12345-192.168.204.51@tcp:256:mount.lustre.0 20000000:01000000:3.0:1782480915.806071:0:14232:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1782480915.806094:0:14232:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1782480915.806103:0:14232:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1782480915.806106:0:14232:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1782480915.806109:0:14232:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1782480915.808203:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a33a5c0-4183-4286-a4af-4c77608d8db6+9:13725:x1869066291750528:12345-192.168.204.51@tcp:256:mount.lustre.0 Request processed in 2152us (2359us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480915.808216:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:1.0:1782480915.810852:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480915.810988:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291750656 00000100:00100000:0.0:1782480915.810996:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291750656 00000100:00100000:0.0:1782480915.811113:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:0.0:1782480915.811123:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+9:13725:x1869066291750656:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782480915.811146:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480915.811163:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d413f4400/0x3dc3ebf33c024ddf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fc2f expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480915.811189:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d413f4400/0x3dc3ebf33c024ddf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc2f expref: 10 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480915.811199:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d413f4400/0x3dc3ebf33c024ddf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc2f expref: 10 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480915.811207:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d413f4400, rc 0) 00000100:00100000:0.0:1782480915.811259:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+10:13725:x1869066291750656:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 138us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480915.811265:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:3.0:1782480915.813445:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480915.814819:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291750784 00000100:00100000:2.0:1782480915.814832:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291750784 00000100:00100000:2.0:1782480915.815291:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:2.0:1782480915.815304:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+10:13725:x1869066291750784:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782480915.815585:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+10:13725:x1869066291750784:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 283us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480915.815592:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:3.0:1782480915.817499:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480915.817769:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291750912 00000100:00100000:2.0:1782480915.817778:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291750912 00000100:00100000:2.0:1782480915.817834:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:2.0:1782480915.817843:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+10:13725:x1869066291750912:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782480915.818641:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+10:13725:x1869066291750912:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 795us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480915.818650:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:3.0:1782480915.822411:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480915.822479:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291751040 00000100:00100000:0.0:1782480915.822490:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291751040 00000100:00100000:0.0:1782480915.822552:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 89 00000100:00100000:0.0:1782480915.822562:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+10:13747:x1869066291751040:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782480915.824056:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+10:13747:x1869066291751040:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 1489us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480915.824069:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 89 00000100:00100000:3.0:1782480915.830912:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480915.831458:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291751168 00000100:00100000:1.0:1782480915.831469:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291751168 00000100:00100000:1.0:1782480915.831530:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 90 00000100:00100000:1.0:1782480915.831540:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a33a5c0-4183-4286-a4af-4c77608d8db6+10:13747:x1869066291751168:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782480915.831853:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a33a5c0-4183-4286-a4af-4c77608d8db6+10:13747:x1869066291751168:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 312us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480915.831862:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 90 00000100:00100000:1.0:1782480915.840995:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480915.841296:0:14239:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291751296 00000100:00100000:0.0:1782480915.841305:0:14239:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291751296 00000100:00100000:0.0:1782480915.841360:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:0.0:1782480915.841369:0:14239:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2365:x1869066291751296:12345-192.168.204.51@tcp:38:mount.lustre.0 00010000:00080000:0.0:1782480915.841399:0:14239:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from ec9c8cec-df0d-4fc3-b99c-4da053dab250@192.168.204.51@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:0.0:1782480915.841450:0:14239:0:(genops.c:1406:class_connect()) connect: client ec9c8cec-df0d-4fc3-b99c-4da053dab250, cookie 0x3dc3ebf33c024de6 00000004:00100000:0.0:1782480915.841481:0:14239:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1782480915.841487:0:14239:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1782480915.871115:0:14239:0:(import.c:65:import_set_state_nolock()) ffff9b6d43a9a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782480915.871370:0:14239:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+6:2365:x1869066291751296:12345-192.168.204.51@tcp:38:mount.lustre.0 Request processed in 29998us (30380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480915.871381:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:3.0:1782480915.879352:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480915.879450:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480915.879618:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291751424 00000100:00100000:1.0:1782480915.879629:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291751424 00000100:00100000:1.0:1782480915.879700:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291751552 00000100:00100000:1.0:1782480915.879704:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291751552 00000100:00100000:1.0:1782480915.879732:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:1.0:1782480915.879742:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+7:0:x1869066291751424:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782480915.879825:0:14238:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1782480915.879882:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480915.879918:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+7:0:x1869066291751424:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 176us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480915.879928:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:1.0:1782480915.879948:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:1.0:1782480915.879956:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+6:13725:x1869066291751552:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782480915.879969:0:14238:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782480915.880010:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+6:13725:x1869066291751552:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 54us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480915.880018:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:3.0:1782480915.882267:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480915.882437:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291751680 00000100:00100000:0.0:1782480915.882445:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291751680 00000100:00100000:0.0:1782480915.882521:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:0.0:1782480915.882531:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+6:13725:x1869066291751680:12345-192.168.204.51@tcp:40:mount.lustre.0 00000100:00100000:0.0:1782480915.882612:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+6:13725:x1869066291751680:12345-192.168.204.51@tcp:40:mount.lustre.0 Request processed in 83us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480915.882620:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:3.0:1782480915.885798:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480915.885846:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480915.885903:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480915.886047:0:14241:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291752064 00000100:00100000:1.0:1782480915.886057:0:14241:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291752064 00000100:00100000:1.0:1782480915.886101:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:1.0:1782480915.886110:0:14241:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+6:13725:x1869066291752064:12345-192.168.204.51@tcp:33:mount.lustre.0 00000004:00080000:1.0:1782480915.886695:0:14241:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 512us 00000100:00100000:2.0:1782480915.887060:0:15624:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291751808 00000100:00100000:2.0:1782480915.887067:0:15624:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291751808 00000100:00100000:2.0:1782480915.887100:0:15624:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291751936 00000100:00100000:2.0:1782480915.887103:0:15624:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291751936 00000100:00100000:2.0:1782480915.887121:0:15624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:2.0:1782480915.887139:0:15624:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2365:x1869066291751808:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782480915.887164:0:15624:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from ec9c8cec-df0d-4fc3-b99c-4da053dab250@192.168.204.51@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:2.0:1782480915.887199:0:15624:0:(genops.c:1406:class_connect()) connect: client ec9c8cec-df0d-4fc3-b99c-4da053dab250, cookie 0x3dc3ebf33c024ded 00002000:00100000:2.0:1782480915.887211:0:15624:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ec9c8cec-df0d-4fc3-b99c-4da053dab250/ffff9b6d7f28f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211365f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782480915.887236:0:15624:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782480915.887554:0:15624:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782480915.887587:0:15624:0:(import.c:65:import_set_state_nolock()) ffff9b6d7f28e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782480915.887652:0:15624:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+6:2365:x1869066291751808:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 513us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480915.887659:0:15624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:2.0:1782480915.887676:0:15624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:2.0:1782480915.887680:0:15624:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2365:x1869066291751936:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782480915.887695:0:15624:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from ec9c8cec-df0d-4fc3-b99c-4da053dab250@192.168.204.51@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:2.0:1782480915.887710:0:15624:0:(genops.c:1406:class_connect()) connect: client ec9c8cec-df0d-4fc3-b99c-4da053dab250, cookie 0x3dc3ebf33c024df4 00002000:00100000:2.0:1782480915.887715:0:15624:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ec9c8cec-df0d-4fc3-b99c-4da053dab250/ffff9b6d7f28a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211365f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782480915.887730:0:15624:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782480915.887973:0:15624:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782480915.887995:0:15624:0:(import.c:65:import_set_state_nolock()) ffff9b6d7f288000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782480915.888027:0:15624:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+6:2365:x1869066291751936:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 339us (2117us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480915.888035:0:15624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000004:00200000:3.0:1782480915.902346:0:14241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1782480915.902544:0:14241:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+6:13725:x1869066291752064:12345-192.168.204.51@tcp:33:mount.lustre.0 Request processed in 16429us (16691us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480915.902559:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:3.0:1782480916.104789:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480916.104930:0:15901:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291752192 00000100:00100000:2.0:1782480916.104940:0:15901:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291752192 00000100:00100000:2.0:1782480916.105008:0:15901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:2.0:1782480916.105018:0:15901:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+6:13767:x1869066291752192:12345-192.168.204.51@tcp:101:mkdir.0 00010000:00010000:2.0:1782480916.105039:0:15901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480916.105063:0:15901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024dfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fc59 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480916.105132:0:15901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024e02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480916.105147:0:15901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024e02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480916.105160:0:15901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024e02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480916.105359:0:15901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782480916.105363:0:15901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480916.105456:0:15901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024e02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480916.105485:0:15901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9800/0x3dc3ebf33c024dfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc59 expref: 8 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480916.105516:0:15901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024e02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc59 expref: 7 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480916.105525:0:15901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d45d62d00) 00010000:00010000:2.0:1782480916.105527:0:15901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782480916.105531:0:15901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e8200, rc 0) 00000100:00100000:2.0:1782480916.105732:0:15901:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+7:13767:x1869066291752192:12345-192.168.204.51@tcp:101:mkdir.0 Request processed in 714us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480916.105740:0:15901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00010000:00010000:0.0:1782480916.791806:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782480917.812417:0:7497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec9c8cec-df0d-4fc3-b99c-4da053dab250 00010000:00010000:1.0:1782480917.815082:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480918.189653:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480918.189945:0:14239:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291752320 00000100:00100000:2.0:1782480918.189956:0:14239:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291752320 00000100:00100000:2.0:1782480918.190035:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:2.0:1782480918.190046:0:14239:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+7:13821:x1869066291752320:12345-192.168.204.51@tcp:41:lfs.0 00000004:00000024:2.0:1782480918.190094:0:14239:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1782480918.190192:0:14239:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+7:13821:x1869066291752320:12345-192.168.204.51@tcp:41:lfs.0 Request processed in 148us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480918.190199:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00080000:3.0:1782480918.191062:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480918.194037:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480918.194368:0:14878:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291752448 00000100:00100000:0.0:1782480918.194401:0:14878:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291752448 00000100:00100000:0.0:1782480918.194493:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:0.0:1782480918.194504:0:14878:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec9c8cec-df0d-4fc3-b99c-4da053dab250+6:13821:x1869066291752448:12345-192.168.204.51@tcp:13:lfs.0 00002000:00000024:0.0:1782480918.194543:0:14878:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480918.194630:0:14878:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec9c8cec-df0d-4fc3-b99c-4da053dab250+6:13821:x1869066291752448:12345-192.168.204.51@tcp:13:lfs.0 Request processed in 127us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480918.194637:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00080000:3.0:1782480918.194868:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480918.197520:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480918.202326:0:14878:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291752576 00000100:00100000:3.0:1782480918.202345:0:14878:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291752576 00000100:00100000:3.0:1782480918.203326:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:3.0:1782480918.203340:0:14878:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec9c8cec-df0d-4fc3-b99c-4da053dab250+5:13821:x1869066291752576:12345-192.168.204.51@tcp:13:lfs.0 00002000:00000024:3.0:1782480918.203385:0:14878:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480918.203474:0:14878:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ec9c8cec-df0d-4fc3-b99c-4da053dab250+5:13821:x1869066291752576:12345-192.168.204.51@tcp:13:lfs.0 Request processed in 138us (5962us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480918.203496:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00080000:1.0:1782480918.204014:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782480918.387291:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480918.388548:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291752704 00000100:00100000:0.0:1782480918.388564:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291752704 00000100:00100000:0.0:1782480918.388850:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:0.0:1782480918.388862:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+10:13852:x1869066291752704:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782480918.388882:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480918.388902:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d413f5a00/0x3dc3ebf33c024e09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fc60 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480918.388943:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d413f5a00/0x3dc3ebf33c024e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc60 expref: 11 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480918.388956:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d413f5a00/0x3dc3ebf33c024e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc60 expref: 11 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480918.388965:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d413f5a00, rc 0) 00000100:00100000:0.0:1782480918.389042:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76290c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+11:13852:x1869066291752704:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 182us (1761us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480918.389050:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:0.0:1782480918.398222:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480918.398347:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291752832 00000100:00100000:2.0:1782480918.398359:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291752832 00000100:00100000:2.0:1782480918.398471:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 92 00000100:00100000:2.0:1782480918.398484:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+11:13852:x1869066291752832:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782480918.398849:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+11:13852:x1869066291752832:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 367us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480918.398867:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 92 00000100:00100000:3.0:1782480918.404160:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480918.404789:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291752960 00000100:00100000:0.0:1782480918.404799:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291752960 00000100:00100000:0.0:1782480918.404873:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 93 00000100:00100000:0.0:1782480918.404884:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+11:13852:x1869066291752960:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782480918.405776:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76292c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+11:13852:x1869066291752960:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 303us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480918.405789:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 93 00000100:00100000:3.0:1782480918.414067:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480918.416145:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291753088 00000100:00100000:2.0:1782480918.416162:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291753088 00000100:00100000:2.0:1782480918.416240:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00100000:2.0:1782480918.416253:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+11:13859:x1869066291753088:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782480918.416555:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+11:13859:x1869066291753088:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 304us (2497us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480918.416564:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00100000:3.0:1782480918.449418:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480918.449558:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291753216 00000100:00100000:1.0:1782480918.449571:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291753216 00000100:00100000:1.0:1782480918.449635:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00100000:1.0:1782480918.449646:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a33a5c0-4183-4286-a4af-4c77608d8db6+11:13859:x1869066291753216:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782480918.450007:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a33a5c0-4183-4286-a4af-4c77608d8db6+11:13859:x1869066291753216:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 361us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480918.450017:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00100000:3.0:1782480918.456926:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480918.459682:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291753344 00000100:00100000:0.0:1782480918.459697:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291753344 00000100:00100000:0.0:1782480918.459784:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00100000:0.0:1782480918.459795:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d76293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+11:13852:x1869066291753344:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782480918.459823:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480918.459843:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d413f4e00/0x3dc3ebf33c024e10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fc8a expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480918.459870:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d413f4e00/0x3dc3ebf33c024e10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc8a expref: 12 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480918.459880:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d413f4e00/0x3dc3ebf33c024e10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc8a expref: 12 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480918.460266:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d413f4e00, rc 0) 00000100:00100000:0.0:1782480918.460455:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d76293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+12:13852:x1869066291753344:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 660us (3538us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480918.460462:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00100000:3.0:1782480918.464048:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480918.464276:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291753472 00000100:00100000:2.0:1782480918.464286:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291753472 00000100:00100000:2.0:1782480918.464344:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 97 00000100:00100000:2.0:1782480918.464354:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+12:13852:x1869066291753472:12345-192.168.204.51@tcp:256:mount.lustre.0 20000000:01000000:2.0:1782480918.464380:0:14231:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1782480918.464403:0:14231:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782480918.464408:0:14231:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1782480918.464411:0:14231:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1782480918.464414:0:14231:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1782480918.466250:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+12:13852:x1869066291753472:12345-192.168.204.51@tcp:256:mount.lustre.0 Request processed in 1887us (2201us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480918.466264:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 97 00000100:00100000:3.0:1782480918.470300:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480918.470452:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291753600 00000100:00100000:0.0:1782480918.470465:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291753600 00000100:00100000:0.0:1782480918.470537:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 98 00000100:00100000:0.0:1782480918.470547:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+12:13852:x1869066291753600:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782480918.470564:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480918.470581:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d413f5200/0x3dc3ebf33c024e17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fc91 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480918.470607:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d413f5200/0x3dc3ebf33c024e17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc91 expref: 13 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480918.470617:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d413f5200/0x3dc3ebf33c024e17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc91 expref: 13 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480918.470626:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d413f5200, rc 0) 00000100:00100000:0.0:1782480918.470679:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+13:13852:x1869066291753600:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 133us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480918.470685:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 98 00000100:00100000:3.0:1782480918.473249:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480918.473640:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291753728 00000100:00100000:2.0:1782480918.473649:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291753728 00000100:00100000:2.0:1782480918.473705:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 99 00000100:00100000:2.0:1782480918.474219:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+13:13852:x1869066291753728:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1782480918.474623:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+13:13852:x1869066291753728:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 408us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480918.476551:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 99 00000100:00100000:3.0:1782480918.477647:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480918.477832:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291753856 00000100:00100000:1.0:1782480918.477841:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291753856 00000100:00100000:1.0:1782480918.477908:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 100 00000100:00100000:1.0:1782480918.477918:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a33a5c0-4183-4286-a4af-4c77608d8db6+13:13852:x1869066291753856:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:1.0:1782480918.478168:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a33a5c0-4183-4286-a4af-4c77608d8db6+13:13852:x1869066291753856:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 251us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480918.478176:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 100 00000100:00100000:3.0:1782480918.484945:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480918.485031:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291753984 00000100:00100000:0.0:1782480918.485041:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291753984 00000100:00100000:0.0:1782480918.486201:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 101 00000100:00100000:0.0:1782480918.486218:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+13:13862:x1869066291753984:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782480918.486507:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+13:13862:x1869066291753984:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 294us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480918.486516:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 101 00000100:00100000:3.0:1782480918.490687:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480918.490964:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291754112 00000100:00100000:2.0:1782480918.490985:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291754112 00000100:00100000:2.0:1782480918.491048:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 102 00000100:00100000:2.0:1782480918.491068:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+13:13862:x1869066291754112:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782480918.491345:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+13:13862:x1869066291754112:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 287us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480918.491354:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 102 00000100:00100000:3.0:1782480918.500628:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480918.500676:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480918.500720:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480918.500739:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291754624 00000100:00100000:0.0:1782480918.500773:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291754624 00000100:00100000:2.0:1782480918.500831:0:15901:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291754240 00000100:00100000:2.0:1782480918.500836:0:15901:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291754240 00000100:00100000:0.0:1782480918.500838:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:0.0:1782480918.500848:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+7:2367:x1869066291754624:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480918.500860:0:15901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:2.0:1782480918.500865:0:15901:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2365:x1869066291754240:12345-192.168.204.51@tcp:38:mount.lustre.0 00010000:00080000:2.0:1782480918.500888:0:15901:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 9fa3cdb8-ed90-4062-a387-0c5cebb8035f@192.168.204.51@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:2.0:1782480918.500928:0:15901:0:(genops.c:1406:class_connect()) connect: client 9fa3cdb8-ed90-4062-a387-0c5cebb8035f, cookie 0x3dc3ebf33c024e1e 00000100:00100000:0.0:1782480918.500948:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+7:2367:x1869066291754624:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 102us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480918.500955:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000004:00100000:2.0:1782480918.500959:0:15901:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1782480918.501202:0:15901:0:(import.c:65:import_set_state_nolock()) ffff9b6d7f28a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782480918.501250:0:15901:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+6:2365:x1869066291754240:12345-192.168.204.51@tcp:38:mount.lustre.0 Request processed in 383us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480918.501257:0:15901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:1.0:1782480918.502841:0:15624:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291754880 00000100:00100000:1.0:1782480918.502854:0:15624:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291754880 00000100:00100000:1.0:1782480918.503094:0:15624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:1.0:1782480918.503106:0:15624:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+5:2367:x1869066291754880:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480918.503202:0:15624:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+5:2367:x1869066291754880:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 98us (2481us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480918.503210:0:15624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:3.0:1782480918.508661:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480918.508691:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480918.510170:0:14876:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291754752 00000100:00100000:2.0:1782480918.510183:0:14876:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291754752 00000100:00100000:2.0:1782480918.510253:0:14876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:2.0:1782480918.510264:0:14876:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+6:2367:x1869066291754752:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480918.510350:0:14876:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+6:2367:x1869066291754752:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 88us (1698us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480918.510372:0:14876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:2.0:1782480918.510458:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291754368 00000100:00100000:2.0:1782480918.510464:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291754368 00000100:00100000:2.0:1782480918.510513:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:2.0:1782480918.510520:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+6:0:x1869066291754368:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782480918.510544:0:14240:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1782480918.510581:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+6:0:x1869066291754368:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 61us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480918.510587:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00080000:2.0:1782480918.510615:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480918.513684:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480918.513920:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291754496 00000100:00100000:0.0:1782480918.513933:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291754496 00000100:00100000:0.0:1782480918.514004:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:0.0:1782480918.514015:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+6:13852:x1869066291754496:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782480918.514053:0:14238:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782480918.517343:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+6:13852:x1869066291754496:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 3316us (3656us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480918.517358:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:3.0:1782480918.522251:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480918.522328:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291755008 00000100:00100000:2.0:1782480918.522339:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291755008 00000100:00100000:2.0:1782480918.522572:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:2.0:1782480918.522585:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+6:13852:x1869066291755008:12345-192.168.204.51@tcp:40:mount.lustre.0 00000100:00100000:2.0:1782480918.523045:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+6:13852:x1869066291755008:12345-192.168.204.51@tcp:40:mount.lustre.0 Request processed in 165us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480918.523055:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:0.0:1782480918.525171:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480918.525212:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480918.525249:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480918.525414:0:14242:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291755392 00000100:00100000:3.0:1782480918.525425:0:14242:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291755392 00000100:00100000:3.0:1782480918.525483:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:3.0:1782480918.525493:0:14242:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+6:13852:x1869066291755392:12345-192.168.204.51@tcp:33:mount.lustre.0 00000004:00200000:3.0:1782480918.525794:0:14242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1782480918.525963:0:14242:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+6:13852:x1869066291755392:12345-192.168.204.51@tcp:33:mount.lustre.0 Request processed in 470us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480918.525972:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:1.0:1782480918.527885:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291755136 00000100:00100000:1.0:1782480918.527898:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291755136 00000100:00100000:1.0:1782480918.527947:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291755264 00000100:00100000:1.0:1782480918.527951:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291755264 00000100:00100000:1.0:1782480918.527986:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:1.0:1782480918.527995:0:14873:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2365:x1869066291755136:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782480918.528029:0:14873:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 9fa3cdb8-ed90-4062-a387-0c5cebb8035f@192.168.204.51@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:1.0:1782480918.528073:0:14873:0:(genops.c:1406:class_connect()) connect: client 9fa3cdb8-ed90-4062-a387-0c5cebb8035f, cookie 0x3dc3ebf33c024e25 00000100:00100000:0.0:1782480918.528407:0:15624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:0.0:1782480918.528414:0:15624:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2365:x1869066291755264:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:0.0:1782480918.528431:0:15624:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 9fa3cdb8-ed90-4062-a387-0c5cebb8035f@192.168.204.51@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:0.0:1782480918.528451:0:15624:0:(genops.c:1406:class_connect()) connect: client 9fa3cdb8-ed90-4062-a387-0c5cebb8035f, cookie 0x3dc3ebf33c024e2c 00002000:00100000:0.0:1782480918.528463:0:15624:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9fa3cdb8-ed90-4062-a387-0c5cebb8035f/ffff9b6d453b2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211365f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782480918.528484:0:15624:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782480918.528775:0:15624:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782480918.529256:0:15624:0:(import.c:65:import_set_state_nolock()) ffff9b6d453b7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782480918.529332:0:15624:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+6:2365:x1869066291755264:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 916us (4081us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480918.529357:0:15624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00002000:00100000:1.0:1782480918.530546:0:14873:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9fa3cdb8-ed90-4062-a387-0c5cebb8035f/ffff9b6d47c9e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211365f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782480918.530562:0:14873:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782480918.530679:0:14873:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782480918.530711:0:14873:0:(import.c:65:import_set_state_nolock()) ffff9b6d47c9f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782480918.530794:0:14873:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+6:2365:x1869066291755136:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 2785us (5567us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480918.530804:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:0.0:1782480918.699131:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480918.699233:0:15901:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291755520 00000100:00100000:1.0:1782480918.699242:0:15901:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291755520 00000100:00100000:1.0:1782480918.699304:0:15901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:1.0:1782480918.699315:0:15901:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+6:13883:x1869066291755520:12345-192.168.204.51@tcp:101:mkdir.0 00010000:00010000:1.0:1782480918.699337:0:15901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480918.699361:0:15901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024e33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fcbb expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480918.699447:0:15901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024e3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480918.699460:0:15901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024e3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480918.699474:0:15901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024e3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480918.699675:0:15901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782480918.699680:0:15901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1782480918.699790:0:15901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024e3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480918.699827:0:15901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024e33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcbb expref: 8 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480918.699845:0:15901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024e3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcbb expref: 7 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480918.699853:0:15901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d45d62d00) 00010000:00010000:1.0:1782480918.702866:0:15901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782480918.702875:0:15901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572200, rc 0) 00000100:00100000:1.0:1782480918.703118:0:15901:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+7:13883:x1869066291755520:12345-192.168.204.51@tcp:101:mkdir.0 Request processed in 3801us (3992us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480918.703129:0:15901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:3.0:1782480918.775044:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782480918.775067:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311668992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480918.775137:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480918.775210:0:14878:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311668992 00000100:00100000:3.0:1782480918.775218:0:14878:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311668992 00000100:00100000:3.0:1782480918.775274:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782480918.775282:0:14878:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311668992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782480918.775307:0:14878:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480918.775366:0:14878:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311668992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480918.775372:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1782480918.775398:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782480918.775433:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311668992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480918.775653:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311669248:0@lo:400:kworker.0 00000100:00100000:1.0:1782480918.775682:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480918.775715:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782480918.775721:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311669376:0@lo:400:kworker.0 00000100:00100000:1.0:1782480918.775743:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480918.775788:0:14876:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311669248 00000100:00100000:1.0:1782480918.775793:0:14876:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311669248 00000100:00100000:1.0:1782480918.775843:0:14876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782480918.775849:0:14876:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311669248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480918.775885:0:14876:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311669248:12345-0@lo:400:kworker.0 Request processed in 37us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480918.775892:0:14876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782480918.775917:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311669248:0@lo:400:kworker.0 00000100:00080000:1.0:1782480918.775932:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480918.775943:0:14239:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311669376 00000100:00100000:1.0:1782480918.775946:0:14239:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311669376 00000100:00100000:1.0:1782480918.775974:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782480918.775980:0:14239:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311669376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480918.776013:0:14239:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311669376:12345-0@lo:400:kworker.0 Request processed in 34us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480918.776019:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782480918.776041:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311669376:0@lo:400:kworker.0 00000100:00100000:0.0:1782480918.776110:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311669504:0@lo:400:kworker.0 00000100:00100000:0.0:1782480918.776145:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480918.776175:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782480918.776181:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3317:1869066311669120:0@lo:400:kworker.0 00000100:00100000:0.0:1782480918.776206:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480918.776231:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311669632:0@lo:400:kworker.0 00000100:00100000:0.0:1782480918.776251:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480918.776273:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311669120 00000100:00100000:0.0:1782480918.776276:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311669120 00000100:00100000:0.0:1782480918.776302:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1782480918.776311:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:3317:x1869066311669120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480918.776343:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:3317:x1869066311669120:12345-0@lo:400:kworker.0 Request processed in 33us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480918.776349:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1782480918.776381:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3317:1869066311669120:0@lo:400:kworker.0 00000100:00100000:1.0:1782480918.776661:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782480918.776670:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311669760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480918.776696:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480918.776732:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311669504 00000100:00100000:1.0:1782480918.776736:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311669504 00000100:00100000:1.0:1782480918.776788:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311669632 00000100:00100000:1.0:1782480918.776792:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311669632 00000100:00100000:1.0:1782480918.776838:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782480918.776844:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311669504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480918.776877:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1869066311669504:12345-0@lo:400:kworker.0 Request processed in 33us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480918.776882:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782480918.776892:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782480918.776897:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311669632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480918.776918:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311669632:12345-0@lo:400:kworker.0 Request processed in 21us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480918.776923:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782480918.776946:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311669632:0@lo:400:kworker.0 00000100:00100000:1.0:1782480918.776955:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3317:1869066311669504:0@lo:400:kworker.0 00000100:00080000:0.0:1782480918.777021:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480918.777071:0:14878:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311669760 00000100:00100000:2.0:1782480918.777075:0:14878:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311669760 00000100:00100000:2.0:1782480918.777109:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782480918.777116:0:14878:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311669760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782480918.777131:0:14878:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480918.777176:0:14878:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311669760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480918.777182:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782480918.777525:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311669760:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782480918.839038:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480919.864245:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782480920.364464:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9fa3cdb8-ed90-4062-a387-0c5cebb8035f 00000001:00100000:2.0:1782480920.364481:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec9c8cec-df0d-4fc3-b99c-4da053dab250 00010000:00010000:0.0:1782480920.887221:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782480921.386105:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ec9c8cec-df0d-4fc3-b99c-4da053dab250 00000001:00100000:1.0:1782480921.386123:0:5829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9fa3cdb8-ed90-4062-a387-0c5cebb8035f 00000001:02000400:0.0:1782480921.617513:0:16107:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1782480921.911568:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782480922.924573:0:7497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9fa3cdb8-ed90-4062-a387-0c5cebb8035f 00010000:00010000:0.0:1782480922.935211:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480923.736943:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480923.736983:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480923.737004:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480923.737032:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480923.737051:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480923.737066:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480923.737084:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480923.737122:0:14874:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291756032 00000100:00100000:3.0:1782480923.737143:0:14874:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291756032 00000100:00100000:3.0:1782480923.737195:0:14874:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291756288 00000100:00100000:3.0:1782480923.737198:0:14874:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291756288 00000100:00100000:3.0:1782480923.737213:0:14874:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291755904 00000100:00100000:3.0:1782480923.737216:0:14874:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291755904 00000100:00100000:3.0:1782480923.737230:0:14874:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291756416 00000100:00100000:1.0:1782480923.737235:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291755776 00000100:00100000:1.0:1782480923.737241:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291755776 00000100:00100000:3.0:1782480923.737249:0:14874:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291756416 00000100:00100000:1.0:1782480923.737274:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291756160 00000100:00100000:1.0:1782480923.737278:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291756160 00000100:00100000:3.0:1782480923.737299:0:14874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:1.0:1782480923.737308:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:3.0:1782480923.737315:0:14874:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+5:2367:x1869066291756032:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480923.737323:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+6:2367:x1869066291755776:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480923.739629:0:14874:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+5:2367:x1869066291756032:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 2309us (2633us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480923.739644:0:14874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:3.0:1782480923.739678:0:14874:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:3.0:1782480923.739691:0:14874:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+5:2367:x1869066291756288:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480923.742637:0:15624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:0.0:1782480923.742668:0:15624:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+5:2367:x1869066291755904:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480923.747211:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+6:2367:x1869066291755776:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 9878us (10260us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480923.747227:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:1.0:1782480923.747269:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:1.0:1782480923.747296:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+6:2367:x1869066291756160:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480923.747377:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+6:2367:x1869066291756160:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 75us (10295us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480923.747385:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:1.0:1782480923.747418:0:14873:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1782480923.747427:0:14873:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1782480923.747458:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291755648 00000100:00100000:1.0:1782480923.747468:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291755648 00000100:00100000:1.0:1782480923.747516:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 104 00000100:00100000:1.0:1782480923.747525:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a33a5c0-4183-4286-a4af-4c77608d8db6+13:2367:x1869066291755648:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480923.747557:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a33a5c0-4183-4286-a4af-4c77608d8db6+13:2367:x1869066291755648:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 33us (10524us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480923.747563:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 104 00000100:00100000:1.0:1782480923.747935:0:14876:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1782480923.747945:0:14876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:1.0:1782480923.747954:0:14876:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+5:2367:x1869066291756416:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480923.748149:0:14876:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+5:2367:x1869066291756416:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 197us (11063us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480923.748156:0:14876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00080000:1.0:1782480923.749736:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782480923.749743:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782480923.749759:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782480923.752418:0:14874:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+5:2367:x1869066291756288:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 12718us (15399us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480923.752435:0:14874:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:0.0:1782480923.753341:0:15624:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+5:2367:x1869066291755904:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 10677us (16280us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480923.753437:0:15624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:3.0:1782480923.896099:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311669888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480923.896173:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480923.896367:0:14878:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311669888 00000100:00100000:2.0:1782480923.896375:0:14878:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311669888 00000100:00100000:2.0:1782480923.896443:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782480923.896452:0:14878:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311669888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782480923.896488:0:14878:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480923.896538:0:14878:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311669888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480923.896545:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782480923.896594:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311669888:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782480923.899485:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782480923.901279:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782480923.901301:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311670016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480923.901374:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480923.901414:0:14878:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311670016 00000100:00100000:2.0:1782480923.901421:0:14878:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311670016 00000100:00100000:2.0:1782480923.901470:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782480923.901478:0:14878:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311670016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782480923.901514:0:14878:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480923.901558:0:14878:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311670016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480923.901565:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1782480923.901586:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480923.901619:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311670016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480923.902104:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311670272:0@lo:400:kworker.0 00000100:00100000:0.0:1782480923.902138:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480923.902160:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782480923.902166:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311670400:0@lo:400:kworker.0 00000100:00100000:0.0:1782480923.902188:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480923.902214:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311670272 00000100:00100000:0.0:1782480923.902218:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311670272 00000100:00100000:0.0:1782480923.902248:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311670400 00000100:00100000:0.0:1782480923.902251:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311670400 00000100:00100000:0.0:1782480923.902273:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782480923.902280:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311670272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480923.902316:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1869066311670272:12345-0@lo:400:kworker.0 Request processed in 38us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480923.902323:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782480923.902335:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782480923.902341:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311670400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480923.902367:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1869066311670400:12345-0@lo:400:kworker.0 Request processed in 27us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480923.902372:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1782480923.902395:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480923.902415:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3315:1869066311670400:0@lo:400:kworker.0 00000100:00100000:0.0:1782480923.902424:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3315:1869066311670272:0@lo:400:kworker.0 00000100:00100000:3.0:1782480923.902614:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311670528:0@lo:400:kworker.0 00000100:00100000:3.0:1782480923.902649:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480923.902680:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782480923.902686:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3317:1869066311670144:0@lo:400:kworker.0 00000100:00100000:3.0:1782480923.902727:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480923.903337:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311670528 00000100:00100000:0.0:1782480923.903344:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311670528 00000100:00100000:0.0:1782480923.903436:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782480923.903444:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311670528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480923.903487:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1869066311670528:12345-0@lo:400:kworker.0 Request processed in 44us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480923.903493:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782480923.903522:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3317:1869066311670528:0@lo:400:kworker.0 00000100:00100000:2.0:1782480923.905292:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311670144 00000100:00100000:2.0:1782480923.905310:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311670144 00000100:00100000:2.0:1782480923.905351:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1782480923.905359:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:3317:x1869066311670144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480923.905426:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:3317:x1869066311670144:12345-0@lo:400:kworker.0 Request processed in 68us (2698us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480923.905433:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782480923.905823:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3317:1869066311670144:0@lo:400:kworker.0 00000100:00080000:3.0:1782480923.908124:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782480923.959912:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782480924.216481:0:14271:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782480924.983394:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782480925.109038:0:16257:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef8187c60 20000000:00000080:1.0:1782480925.109056:0:16257:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b6d79c64800 uarg=0000000000000000 20000000:01000000:1.0:1782480925.109092:0:16257:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782480925.109104:0:16257:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782480925.109108:0:16257:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1782480925.119492:0:16258:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1782480925.119997:0:16257:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1782480925.140249:0:16257:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782480925.140310:0:16257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b6d6e572a00/0x3dc3ebf33c024e41 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.140332:0:16257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d45d2ca00/0x3dc3ebf33c024b38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024b31 expref: 18 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.140340:0:16257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d45d2cc00/0x3dc3ebf33c024b85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024b7e expref: 18 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.140347:0:16257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d45d2d400/0x3dc3ebf33c024bf5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024bee expref: 18 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.140358:0:16257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d413f4400/0x3dc3ebf33c024ddf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc2f expref: 12 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.140365:0:16257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b6d413f5200/0x3dc3ebf33c024e17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc91 expref: 12 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.140372:0:16257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b6d6e572a00/0x3dc3ebf33c024e41 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.140416:0:16257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d413f5200/0x3dc3ebf33c024e17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc91 expref: 12 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.140433:0:16257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d413f5200/0x3dc3ebf33c024e17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc91 expref: 12 pid: 14233 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480925.140458:0:16257:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755dbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16257:1869066311670656:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480925.142344:0:16257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d413f4400/0x3dc3ebf33c024ddf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc2f expref: 12 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480925.142358:0:16257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d413f4400/0x3dc3ebf33c024ddf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc2f expref: 12 pid: 14233 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480925.142372:0:16257:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16257:1869066311670784:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480925.142406:0:16257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d45d2d400/0x3dc3ebf33c024bf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c024bee expref: 18 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480925.142415:0:16257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d45d2d400/0x3dc3ebf33c024bf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c024bee expref: 18 pid: 14231 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480925.142424:0:16257:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750f9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16257:1869066311670912:0@lo:104: 00000100:00100000:0.0:1782480925.142483:0:16257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782480925.142553:0:16257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d45d2cc00/0x3dc3ebf33c024b85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c024b7e expref: 18 pid: 14231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480925.142560:0:16257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d45d2cc00/0x3dc3ebf33c024b85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c024b7e expref: 18 pid: 14231 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480925.142586:0:16257:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16257:1869066311671040:0@lo:104: 00000100:00100000:0.0:1782480925.142608:0:16257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782480925.148412:0:16257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b6d45d2ca00/0x3dc3ebf33c024b38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3dc3ebf33c024b31 expref: 18 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480925.148432:0:16257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b6d45d2ca00/0x3dc3ebf33c024b38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3dc3ebf33c024b31 expref: 18 pid: 14232 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480925.148460:0:16257:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16257:1869066311671168:0@lo:104: 00000100:00100000:0.0:1782480925.148668:0:16257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480925.150720:0:14221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311670912 00000100:00100000:1.0:1782480925.150732:0:14221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311670912 00000100:00100000:1.0:1782480925.150799:0:14221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311671040 00000100:00100000:1.0:1782480925.150803:0:14221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311671040 00000100:00100000:1.0:1782480925.150821:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782480925.150830:0:14221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+4:16257:x1869066311670912:12345-0@lo:104: 00010000:00010000:1.0:1782480925.150846:0:14221:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024bee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c024bf5 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.150931:0:14221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782480925.150937:0:14221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+4:16257:x1869066311670912:12345-0@lo:104: Request processed in 109us (8455us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480925.150944:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782480925.150965:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782480925.150971:0:14221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+3:16257:x1869066311671040:12345-0@lo:104: 00010000:00010000:1.0:1782480925.150978:0:14221:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8c00/0x3dc3ebf33c024b7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c024b85 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.151017:0:14221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782480925.151021:0:14221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+3:16257:x1869066311671040:12345-0@lo:104: Request processed in 52us (8413us total) trans 0 rc 0/0 00010000:00010000:2.0:1782480925.151022:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1782480925.151027:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1782480925.151030:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024bee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c024bf5 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480925.151037:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572c00 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:2.0:1782480925.151041:0:14227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024bee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c024bf5 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.151047:0:14226:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480925.151049:0:14227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024bee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c024bf5 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480925.151068:0:14227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024bee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c024bf5 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480925.151074:0:14227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782480925.151111:0:14227:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024bee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c024bf5 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480925.151118:0:14227:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782480925.151138:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024bee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c024bf5 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480925.151164:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d6e572c00/0x3dc3ebf33c024bee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c024bf5 expref: -99 pid: 15541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480925.151178:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480925.151180:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480925.151181:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480925.151202:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3318:1869066311671296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782480925.151238:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480925.152536:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311671296 00000100:00100000:1.0:1782480925.152547:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311671296 00010000:00010000:1.0:1782480925.152580:0:14225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d45d2d400/0x3dc3ebf33c024bf5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c024bee expref: 19 pid: 14231 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480925.152617:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782480925.152636:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:3318:x1869066311671296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782480925.152649:0:14225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480925.152655:0:14225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d45d2d400/0x3dc3ebf33c024bf5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c024bee expref: 19 pid: 14231 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.152665:0:14225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d45d2d400/0x3dc3ebf33c024bf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c024bee expref: 19 pid: 14231 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.152691:0:14225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480925.152741:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:3318:x1869066311671296:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480925.152763:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1782480925.152801:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3318:1869066311671296:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782480925.152867:0:16259:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480925.152869:0:16259:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480925.152871:0:16259:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480925.152885:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8c00/0x3dc3ebf33c024b7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c024b85 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.152893:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8c00 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:1.0:1782480925.152897:0:14226:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8c00/0x3dc3ebf33c024b7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c024b85 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.152905:0:14226:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8c00/0x3dc3ebf33c024b7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c024b85 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782480925.152911:0:14226:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8c00/0x3dc3ebf33c024b7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c024b85 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480925.152916:0:14226:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1782480925.152952:0:14226:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8c00/0x3dc3ebf33c024b7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c024b85 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.152958:0:14226:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782480925.152984:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8c00/0x3dc3ebf33c024b7e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c024b85 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.152991:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8c00/0x3dc3ebf33c024b7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c024b85 expref: -99 pid: 14872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.153003:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480925.153005:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480925.153006:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480925.153020:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3315:1869066311671424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782480925.153052:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480925.153093:0:14223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311671424 00000100:00100000:1.0:1782480925.153097:0:14223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311671424 00010000:00010000:1.0:1782480925.153255:0:14223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d45d2cc00/0x3dc3ebf33c024b85 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c024b7e expref: 19 pid: 14231 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480925.153318:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782480925.153325:0:14223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:3315:x1869066311671424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782480925.153334:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480925.153338:0:14223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b6d45d2cc00/0x3dc3ebf33c024b85 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c024b7e expref: 19 pid: 14231 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.153346:0:14223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d45d2cc00/0x3dc3ebf33c024b85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c024b7e expref: 19 pid: 14231 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.153358:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480925.153385:0:14223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:3315:x1869066311671424:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480925.153392:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782480925.153730:0:16257:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49339a80 going to sleep for 11 seconds 00010000:00010000:0.0:1782480925.153760:0:16257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d45d2d400/0x3dc3ebf33c024bf5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c024bee expref: 18 pid: 14231 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480925.153770:0:16257:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750f9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16257:1869066311670912:0@lo:104: 00010000:00010000:0.0:1782480925.153781:0:16257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d45d2cc00/0x3dc3ebf33c024b85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c024b7e expref: 17 pid: 14231 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480925.153789:0:16257:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16257:1869066311671040:0@lo:104: 00000100:00100000:0.0:1782480925.153823:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3315:1869066311671424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782480925.153885:0:14221:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782480925.154081:0:14221:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311671168 00000100:00100000:2.0:1782480925.154086:0:14221:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311671168 00000100:00100000:2.0:1782480925.154124:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782480925.154131:0:14221:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f388050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+3:16257:x1869066311671168:12345-0@lo:104: 00010000:00010000:2.0:1782480925.154141:0:14221:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8800/0x3dc3ebf33c024b31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c024b38 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480925.154183:0:14221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782480925.154188:0:14221:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f388050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+3:16257:x1869066311671168:12345-0@lo:104: Request processed in 59us (5522us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480925.154193:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1782480925.154226:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480925.154230:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8800/0x3dc3ebf33c024b31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3dc3ebf33c024b38 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480925.154242:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8800 already unused, calling callback (ffffffffc1b1fc20) 10000000:00010000:2.0:1782480925.154246:0:14227:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8800/0x3dc3ebf33c024b31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3dc3ebf33c024b38 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480925.154254:0:14227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8800/0x3dc3ebf33c024b31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3dc3ebf33c024b38 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480925.154260:0:14227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8800/0x3dc3ebf33c024b31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3dc3ebf33c024b38 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480925.154265:0:14227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782480925.154290:0:14227:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8800/0x3dc3ebf33c024b31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c024b38 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480925.154296:0:14227:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782480925.154309:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8800/0x3dc3ebf33c024b31 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c024b38 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480925.154316:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9b6d582e8800/0x3dc3ebf33c024b31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3dc3ebf33c024b38 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480925.154329:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480925.154331:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480925.154333:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480925.154587:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782480925.154599:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3315:1869066311671552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782480925.154631:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480925.154699:0:16257:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16257:1869066311671168:0@lo:104: 00000100:00100000:3.0:1782480925.159766:0:14224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311671552 00000100:00100000:3.0:1782480925.159782:0:14224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311671552 00010000:00010000:3.0:1782480925.159830:0:14224:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d45d2ca00/0x3dc3ebf33c024b38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c024b31 expref: 17 pid: 14232 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480925.159861:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782480925.159883:0:14224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d79c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+17:3315:x1869066311671552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782480925.159899:0:14224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480925.159906:0:14224:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9b6d45d2ca00/0x3dc3ebf33c024b38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3dc3ebf33c024b31 expref: 17 pid: 14232 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480925.159916:0:14224:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d45d2ca00/0x3dc3ebf33c024b38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3dc3ebf33c024b31 expref: 17 pid: 14232 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480925.159934:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d45d2ca00/0x3dc3ebf33c024b38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3dc3ebf33c024b31 expref: 17 pid: 14232 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480925.159950:0:14224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480925.160023:0:14224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d79c3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:3315:x1869066311671552:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (5390us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480925.160030:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782480925.160532:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3315:1869066311671552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782480925.163677:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480925.163722:0:16257:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16257:1869066311670784:192.168.204.51@tcp:104: 00000100:00100000:0.0:1782480925.163736:0:16257:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755dbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16257:1869066311670656:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480925.163799:0:16257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b6d6e572a00/0x3dc3ebf33c024e41 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480925.163804:0:14224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291756544 00000100:00100000:2.0:1782480925.163813:0:14224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291756544 00010000:00010000:2.0:1782480925.163850:0:14224:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d413f4400/0x3dc3ebf33c024ddf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc2f expref: 13 pid: 14233 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480925.163884:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:2.0:1782480925.163894:0:14224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a33a5c0-4183-4286-a4af-4c77608d8db6+13:2367:x1869066291756544:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480925.163909:0:14224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480925.163914:0:14224:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9b6d413f4400/0x3dc3ebf33c024ddf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc2f expref: 13 pid: 14233 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480925.163923:0:14224:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d413f4400/0x3dc3ebf33c024ddf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc2f expref: 13 pid: 14233 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480925.163939:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d413f4400/0x3dc3ebf33c024ddf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc2f expref: 13 pid: 14233 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480925.163954:0:14224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480925.164011:0:14224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a33a5c0-4183-4286-a4af-4c77608d8db6+12:2367:x1869066291756544:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 117us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480925.164020:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:2.0:1782480925.165353:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480925.165502:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291756672 00000100:00100000:1.0:1782480925.165520:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291756672 00010000:00010000:1.0:1782480925.165549:0:14225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b6d413f5200/0x3dc3ebf33c024e17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc91 expref: 12 pid: 14233 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480925.165588:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:1.0:1782480925.165596:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a33a5c0-4183-4286-a4af-4c77608d8db6+12:2366:x1869066291756672:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480925.165610:0:14225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480925.165616:0:14225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9b6d413f5200/0x3dc3ebf33c024e17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc91 expref: 12 pid: 14233 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.165627:0:14225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b6d413f5200/0x3dc3ebf33c024e17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc91 expref: 12 pid: 14233 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.165643:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d413f5200/0x3dc3ebf33c024e17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc91 expref: 12 pid: 14233 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.165658:0:14225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b6d6e572a00/0x3dc3ebf33c024e41 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.165666:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d6e572a00/0x3dc3ebf33c024e41 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.165690:0:14225:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d6e572a00/0x3dc3ebf33c024e41 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.165698:0:14225:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b6d6e572a00/0x3dc3ebf33c024e41 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.165705:0:14225:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b6d6e572a00/0x3dc3ebf33c024e41 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.165722:0:14225:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b6d6e572a00/0x3dc3ebf33c024e41 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.165728:0:14225:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572a00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:1.0:1782480925.165732:0:14225:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b6d6e572a00/0x3dc3ebf33c024e41 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.165740:0:14225:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b6d6e572a00/0x3dc3ebf33c024e41 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.165775:0:14225:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b6d6e572a00/0x3dc3ebf33c024e41 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480925.165785:0:14225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480925.165831:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9a33a5c0-4183-4286-a4af-4c77608d8db6+11:2366:x1869066291756672:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 234us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480925.165838:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00010000:00010000:2.0:1782480925.169061:0:16257:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b6d6e572a00/0x3dc3ebf33c024e41 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480925.169081:0:16257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b6d6e572a00/0x3dc3ebf33c024e41 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480925.169089:0:16257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b6d6e572a00/0x3dc3ebf33c024e41 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480926.007239:0:16259:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480926.363241:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480926.363963:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291756800 00000100:00100000:2.0:1782480926.363974:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291756800 00000100:00100000:2.0:1782480926.364036:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 106 00000100:00100000:2.0:1782480926.364047:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+11:13739:x1869066291756800:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480926.364068:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480926.364089:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d582e8000/0x3dc3ebf33c024e48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fcc2 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480926.364121:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d582e8000/0x3dc3ebf33c024e48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcc2 expref: 12 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480926.364132:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d582e8000/0x3dc3ebf33c024e48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcc2 expref: 12 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480926.364142:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e8000, rc 0) 00000100:00100000:2.0:1782480926.364200:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+12:13739:x1869066291756800:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 154us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480926.364206:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 106 00000100:00100000:0.0:1782480926.389444:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480926.390223:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291756928 00000100:00100000:3.0:1782480926.390235:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291756928 00000100:00100000:3.0:1782480926.390290:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 107 00000100:00100000:3.0:1782480926.390299:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a33a5c0-4183-4286-a4af-4c77608d8db6+12:13739:x1869066291756928:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480926.390555:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a33a5c0-4183-4286-a4af-4c77608d8db6+12:13739:x1869066291756928:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 255us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480926.390563:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 107 00000100:00100000:2.0:1782480926.410405:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480926.410610:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291757056 00000100:00100000:3.0:1782480926.410621:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291757056 00000100:00100000:3.0:1782480926.410688:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 108 00000100:00100000:3.0:1782480926.410698:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+12:13739:x1869066291757056:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782480926.410973:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+12:13739:x1869066291757056:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 275us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480926.410982:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 108 00000100:00100000:0.0:1782480926.415398:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480926.415618:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291757184 00000100:00100000:2.0:1782480926.415628:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291757184 00000100:00100000:2.0:1782480926.415710:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 109 00000100:00100000:2.0:1782480926.415721:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+12:13739:x1869066291757184:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480926.415738:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480926.415786:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d582e9200/0x3dc3ebf33c024e4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fcc9 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480926.415834:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d582e9200/0x3dc3ebf33c024e4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcc9 expref: 13 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480926.415845:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d582e9200/0x3dc3ebf33c024e4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcc9 expref: 13 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480926.415854:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9200, rc 0) 00000100:00100000:2.0:1782480926.415930:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+13:13739:x1869066291757184:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 204us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480926.415939:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 109 00000100:00100000:0.0:1782480926.430631:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480926.430878:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291757312 00000100:00100000:3.0:1782480926.430899:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291757312 00000100:00100000:3.0:1782480926.430956:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 110 00000100:00100000:3.0:1782480926.430965:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a33a5c0-4183-4286-a4af-4c77608d8db6+13:13739:x1869066291757312:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480926.431250:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a33a5c0-4183-4286-a4af-4c77608d8db6+13:13739:x1869066291757312:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 283us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480926.431258:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 110 00000100:00100000:3.0:1782480926.433834:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480926.434106:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291757440 00000100:00100000:0.0:1782480926.434117:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291757440 00000100:00100000:0.0:1782480926.434175:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 111 00000100:00100000:0.0:1782480926.434185:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+13:13739:x1869066291757440:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782480926.434401:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9a33a5c0-4183-4286-a4af-4c77608d8db6+13:13739:x1869066291757440:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 216us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480926.434409:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 111 00010000:00010000:1.0:1782480927.034225:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782480927.034435:0:14235:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782480927.034439:0:14235:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9b6d74e86800 from 10 10000000:01000000:0.0:1782480927.034445:0:14235:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782480927.034492:0:14235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d45d2d400/0x3dc3ebf33c024e56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480927.034503:0:14235:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d45d2d400/0x3dc3ebf33c024e56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480927.034514:0:14235:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d45d2d400/0x3dc3ebf33c024e56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480927.034539:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311671680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782480927.034606:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480927.034669:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7ae5d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480927.035146:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311671680 00000100:00100000:2.0:1782480927.035154:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311671680 00000100:00100000:2.0:1782480927.035205:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1782480927.035216:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d45c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+16:14235:x1869066311671680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480927.035230:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480927.035245:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d582e9e00/0x3dc3ebf33c024e5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c024e56 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480927.035269:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d582e9e00/0x3dc3ebf33c024e5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c024e56 expref: 17 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480927.035279:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d582e9e00/0x3dc3ebf33c024e5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024e56 expref: 17 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480927.035289:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9e00, rc 0) 00000100:00100000:2.0:1782480927.035382:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d45c0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+17:14235:x1869066311671680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480927.035403:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1782480927.040129:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311671680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480927.040162:0:14235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d45d2d400/0x3dc3ebf33c024e56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024e5d expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480927.040176:0:14235:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d45d2d400/0x3dc3ebf33c024e56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c024e5d expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480927.040263:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311671808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480927.040325:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480927.040387:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49339000 going to sleep for 11 seconds 00000100:00100000:0.0:1782480927.040442:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311671808 00000100:00100000:0.0:1782480927.040454:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311671808 00000100:00100000:0.0:1782480927.040503:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1782480927.040512:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f318c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+17:14235:x1869066311671808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480927.040794:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f318c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+17:14235:x1869066311671808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 282us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480927.040801:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1782480927.041167:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311671808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480927.041203:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311671936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480927.041243:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480927.041274:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49339000 going to sleep for 11 seconds 00000100:00100000:0.0:1782480927.041312:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311671936 00000100:00100000:0.0:1782480927.041317:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311671936 00000100:00100000:0.0:1782480927.041354:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1782480927.041362:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f318850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+17:14235:x1869066311671936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782480927.041515:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f318850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+17:14235:x1869066311671936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480927.041522:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1782480927.043020:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311671936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782480927.049694:0:16339:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1782480927.049986:0:14235:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1782480927.050013:0:14235:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782480927.050026:0:14235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d45d2d400/0x3dc3ebf33c024e56 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024e5d expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480927.050039:0:14235:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d45d2d400/0x3dc3ebf33c024e56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024e5d expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480927.050050:0:14235:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782480927.050053:0:14235:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9b6d657b4800 from 10 10000000:01000000:1.0:1782480927.050056:0:14235:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782480927.050093:0:14235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573e00/0x3dc3ebf33c024e64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480927.050101:0:14235:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573e00/0x3dc3ebf33c024e64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480927.050111:0:14235:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573e00/0x3dc3ebf33c024e64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480927.050136:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311672064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782480927.050202:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480927.050243:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d493390c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480927.050309:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311672064 00000100:00100000:0.0:1782480927.050317:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311672064 00000100:00100000:0.0:1782480927.050366:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1782480927.050375:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f319050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+17:14235:x1869066311672064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782480927.050388:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480927.050400:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d45d2cc00/0x3dc3ebf33c024e6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c024e64 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480927.050425:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d45d2cc00/0x3dc3ebf33c024e6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c024e64 expref: 18 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480927.050434:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d45d2cc00/0x3dc3ebf33c024e6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024e64 expref: 18 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480927.050443:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2cc00, rc 0) 00000100:00100000:0.0:1782480927.050499:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f319050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ed2e1d0c-2f63-46f9-ac79-60f348db465e+18:14235:x1869066311672064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480927.050505:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1782480927.050552:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311672064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782480927.050565:0:14235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573e00/0x3dc3ebf33c024e64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024e6b expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480927.050574:0:14235:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573e00/0x3dc3ebf33c024e64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c024e6b expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480927.050619:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311672192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480927.050642:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480927.050667:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d76034b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782480927.050679:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311672192 00000100:00100000:0.0:1782480927.050683:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311672192 00000100:00100000:0.0:1782480927.050704:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1782480927.050710:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f319850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+18:14235:x1869066311672192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480927.050988:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f319850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+18:14235:x1869066311672192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480927.050994:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1782480927.051027:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311672192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480927.051055:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311672320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782480927.051087:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480927.051102:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d43987900 going to sleep for 11 seconds 00000100:00100000:0.0:1782480927.051113:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311672320 00000100:00100000:0.0:1782480927.051116:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311672320 00000100:00100000:0.0:1782480927.051143:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1782480927.051149:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f318450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+18:14235:x1869066311672320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782480927.051282:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f318450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+18:14235:x1869066311672320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480927.051289:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1782480927.051325:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311672320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782480927.052011:0:16340:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1782480927.052053:0:14235:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1782480927.052069:0:14235:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782480927.052077:0:14235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573e00/0x3dc3ebf33c024e64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024e6b expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480927.052086:0:14235:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d6e573e00/0x3dc3ebf33c024e64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024e6b expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480927.052095:0:14235:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782480927.052097:0:14235:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9b6d52754000 from 10 10000000:01000000:0.0:1782480927.052100:0:14235:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782480927.052124:0:14235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d45d2ca00/0x3dc3ebf33c024e72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480927.052132:0:14235:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9b6d45d2ca00/0x3dc3ebf33c024e72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480927.052139:0:14235:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9b6d45d2ca00/0x3dc3ebf33c024e72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480927.052156:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311672448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782480927.052192:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480927.052219:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d439873c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480927.052234:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311672448 00000100:00100000:0.0:1782480927.052238:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311672448 00000100:00100000:0.0:1782480927.052265:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1782480927.052271:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f31a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+18:14235:x1869066311672448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782480927.052280:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480927.052290:0:14232:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b6d45d2c400/0x3dc3ebf33c024e79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3dc3ebf33c024e72 expref: -99 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480927.052310:0:14232:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b6d45d2c400/0x3dc3ebf33c024e79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3dc3ebf33c024e72 expref: 19 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480927.052320:0:14232:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b6d45d2c400/0x3dc3ebf33c024e79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3dc3ebf33c024e72 expref: 19 pid: 14232 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480927.052327:0:14232:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2c400, rc 0) 00000100:00100000:0.0:1782480927.052356:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f31a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:14235:x1869066311672448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480927.052362:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1782480927.052395:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311672448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782480927.052407:0:14235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9b6d45d2ca00/0x3dc3ebf33c024e72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024e79 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480927.052415:0:14235:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9b6d45d2ca00/0x3dc3ebf33c024e72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3dc3ebf33c024e79 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480927.052447:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311672576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480927.052467:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480927.052484:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d439873c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480927.052493:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311672576 00000100:00100000:0.0:1782480927.052496:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311672576 00000100:00100000:0.0:1782480927.052513:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1782480927.052518:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f31bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:14235:x1869066311672576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480927.052714:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f31bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:14235:x1869066311672576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480927.052720:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1782480927.052770:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311672576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480927.052796:0:14235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311672704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782480927.052831:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480927.052845:0:14235:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d439873c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480927.052855:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311672704 00000100:00100000:0.0:1782480927.052859:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311672704 00000100:00100000:0.0:1782480927.052879:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1782480927.052884:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f31a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:14235:x1869066311672704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782480927.053003:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f31a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:14235:x1869066311672704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480927.053009:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1782480927.053045:0:14235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ed2e1d0c-2f63-46f9-ac79-60f348db465e:14235:1869066311672704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782480927.058231:0:16341:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1782480927.059683:0:14235:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1782480927.059714:0:14235:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782480927.059726:0:14235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9b6d45d2ca00/0x3dc3ebf33c024e72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024e79 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480927.059739:0:14235:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9b6d45d2ca00/0x3dc3ebf33c024e72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3dc3ebf33c024e79 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.055553:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480928.766407:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480928.766473:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291757568 00000100:00100000:1.0:1782480928.766495:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291757568 00000100:00080000:3.0:1782480928.766692:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480928.767031:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:1.0:1782480928.767044:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+6:14393:x1869066291757568:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480928.767064:0:14240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480928.767083:0:14240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024e80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fcd0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.767145:0:14240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c024e87 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.767158:0:14240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c024e87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.767170:0:14240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c024e87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.767183:0:14240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024e8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.767204:0:14240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024e8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.767211:0:14240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024e8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.767652:0:14240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c024e95 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.767662:0:14240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c024e95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.767669:0:14240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c024e95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480928.767780:0:14240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1782480928.767784:0:14240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1782480928.767875:0:14240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c024e95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.767887:0:14240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c024e87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.767893:0:14240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c024e87 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.767900:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c024e87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.767906:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573c00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480928.767909:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c024e87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.767916:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c024e87 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.769150:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d45d62d00) 00010000:00010000:1.0:1782480928.769157:0:14240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480928.769163:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c024e87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.769171:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c024e87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.769187:0:14240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024e8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.769220:0:14240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024e8e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.769226:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024e8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.769232:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480928.769235:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024e8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.769242:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024e8e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.769251:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b6d5230ff00) 00010000:00010000:1.0:1782480928.769253:0:14240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480928.769257:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024e8e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.769262:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c024e8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.769520:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024e80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcd0 expref: 8 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.769535:0:14240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573000/0x3dc3ebf33c024e95 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcd0 expref: 7 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.769543:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b6d5230f800) 00010000:00010000:1.0:1782480928.769546:0:14240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782480928.769554:0:14240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e573000, rc 0) 00000100:00100000:1.0:1782480928.769637:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+7:14393:x1869066291757568:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 2595us (3239us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480928.769646:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:0.0:1782480928.774716:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480928.776074:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291757824 00000100:00100000:1.0:1782480928.776087:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291757824 00000100:00100000:1.0:1782480928.776277:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:1.0:1782480928.776291:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+7:14393:x1869066291757824:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480928.776314:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480928.776334:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024e9c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fcd7 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.776408:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c024ea3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.776422:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c024ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.776433:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c024ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.776470:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024eaa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.776477:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024eaa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.776484:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024eaa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.777053:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c024eb1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.777071:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c024eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.777079:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c024eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480928.777090:0:14238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1782480928.777337:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c024ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.777345:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c024ea3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.777352:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c024ea3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.777359:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572e00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480928.777363:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c024ea3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.777371:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c024ea3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.777383:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b6d5230f800) 00010000:00010000:1.0:1782480928.777386:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480928.777390:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c024ea3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.777397:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c024ea3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.777408:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024eaa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.777419:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024eaa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.777425:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024eaa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.777429:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480928.777433:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024eaa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.777439:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024eaa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.777447:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b6d5230f200) 00010000:00010000:1.0:1782480928.777450:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480928.777453:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024eaa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.777458:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c024eaa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.777880:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024e9c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcd7 expref: 10 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.777896:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572a00/0x3dc3ebf33c024eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcd7 expref: 9 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.777904:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:1.0:1782480928.777906:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480928.777914:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572a00, rc 0) 00000100:00100000:1.0:1782480928.778000:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+9:14393:x1869066291757824:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1711us (3293us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1782480928.778010:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:2.0:1782480928.791016:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480928.791146:0:15901:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291757952 00000100:00100000:0.0:1782480928.791157:0:15901:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291757952 00000100:00100000:0.0:1782480928.791223:0:15901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:0.0:1782480928.791249:0:15901:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+9:14393:x1869066291757952:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1782480928.791355:0:15901:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+9:14393:x1869066291757952:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 Request processed in 108us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480928.791362:0:15901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:0.0:1782480928.843319:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480928.843947:0:14239:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291758080 00000100:00100000:2.0:1782480928.843959:0:14239:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291758080 00000100:00100000:2.0:1782480928.844022:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:2.0:1782480928.844032:0:14239:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+9:14399:x1869066291758080:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1782480928.844052:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480928.844071:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024ebf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fcde expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844137:0:14239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024ec6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844152:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024ec6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844164:0:14239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024ec6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844195:0:14239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9000/0x3dc3ebf33c024ecd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844203:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9000/0x3dc3ebf33c024ecd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844210:0:14239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9000/0x3dc3ebf33c024ecd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844465:0:14239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024ec6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844474:0:14239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024ec6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844482:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024ec6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844488:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9600 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480928.844493:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024ec6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844500:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024ec6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844514:0:14239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d45d62d00) 00010000:00010000:2.0:1782480928.844517:0:14239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480928.844523:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024ec6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844528:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024ec6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844547:0:14239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9000/0x3dc3ebf33c024ecd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844552:0:14239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9000/0x3dc3ebf33c024ecd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844557:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9000/0x3dc3ebf33c024ecd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844561:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480928.844564:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9000/0x3dc3ebf33c024ecd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844569:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9000/0x3dc3ebf33c024ecd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844575:0:14239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b6d45d62e00) 00010000:00010000:2.0:1782480928.844578:0:14239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480928.844580:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9000/0x3dc3ebf33c024ecd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844585:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9000/0x3dc3ebf33c024ecd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844629:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024ebf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcde expref: 10 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844638:0:14239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d45d62d00) 00010000:00010000:2.0:1782480928.844640:0:14239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480928.844650:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c024ebf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcde expref: 10 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.844660:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9400, rc 0) 00000100:00100000:2.0:1782480928.844734:0:14239:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+9:14399:x1869066291758080:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 702us (1424us total) trans 0 rc 301/301 00000100:00100000:2.0:1782480928.844743:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:2.0:1782480928.852978:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480928.854009:0:14247:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291758208 00000100:00100000:1.0:1782480928.854021:0:14247:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291758208 00000100:00100000:1.0:1782480928.854089:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:1.0:1782480928.854099:0:14247:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+9:14399:x1869066291758208:12345-192.168.204.51@tcp:700:lfs.0 00000100:00100000:1.0:1782480928.854197:0:14247:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+9:14399:x1869066291758208:12345-192.168.204.51@tcp:700:lfs.0 Request processed in 99us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480928.854205:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:0.0:1782480928.857308:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480928.857354:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480928.857392:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480928.857438:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480928.857461:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480928.857479:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480928.857501:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291758336 00000100:00100000:0.0:1782480928.857510:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291758336 00000100:00100000:0.0:1782480928.857554:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:0.0:1782480928.857563:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f31a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a33a5c0-4183-4286-a4af-4c77608d8db6+13:2369:x1869066291758336:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480928.857636:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f31a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9a33a5c0-4183-4286-a4af-4c77608d8db6+13:2369:x1869066291758336:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 73us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480928.857643:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:3.0:1782480928.857834:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291758464 00000100:00100000:3.0:1782480928.857839:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291758464 00000100:00100000:3.0:1782480928.857882:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291758976 00000100:00100000:3.0:1782480928.857885:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291758976 00000100:00100000:3.0:1782480928.857897:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291758592 00000100:00100000:3.0:1782480928.857900:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291758592 00000100:00100000:3.0:1782480928.857911:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291758848 00000100:00100000:3.0:1782480928.857913:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291758848 00000100:00100000:3.0:1782480928.857927:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:3.0:1782480928.857934:0:14873:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+5:2369:x1869066291758464:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480928.857964:0:14873:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+5:2369:x1869066291758464:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 31us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480928.857971:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:3.0:1782480928.857985:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:3.0:1782480928.857991:0:14873:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+5:2369:x1869066291758976:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480928.858037:0:14873:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+5:2369:x1869066291758976:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 45us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480928.858047:0:14876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:1.0:1782480928.858059:0:14876:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+5:2369:x1869066291758592:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1782480928.858094:0:14876:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+5:2369:x1869066291758592:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 38us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480928.858102:0:15901:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291758720 00000100:00100000:2.0:1782480928.858123:0:15901:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291758720 00000100:00100000:2.0:1782480928.858160:0:15901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:2.0:1782480928.858168:0:15901:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+6:2369:x1869066291758720:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1782480928.858202:0:15901:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+6:2369:x1869066291758720:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 36us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480928.858207:0:15901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00080000:0.0:1782480928.858879:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782480928.858884:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782480928.858886:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480928.860510:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:3.0:1782480928.860555:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1782480928.860568:0:14873:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+5:2369:x1869066291758848:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480928.860650:0:14873:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+5:2369:x1869066291758848:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 87us (3169us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480928.860657:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1782480928.860719:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480928.860949:0:14876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:1.0:1782480928.860981:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291759232 00000100:00100000:1.0:1782480928.860988:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291759232 00000100:00100000:1.0:1782480928.861026:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:1.0:1782480928.861034:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+9:14399:x1869066291759232:12345-192.168.204.51@tcp:36:lfs.0 00010000:00010000:1.0:1782480928.861078:0:14240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480928.861100:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8200/0x3dc3ebf33c024e02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fc59 expref: 9 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.861118:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d45d62d00) 00010000:00010000:1.0:1782480928.861123:0:14240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782480928.861824:0:14240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024ed4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.861842:0:14240:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024e3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcbb expref: 5 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.861850:0:14240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024ed4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.861884:0:14240:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024e3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcbb expref: 5 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.861898:0:14240:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024e3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcbb expref: 5 pid: 15901 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480928.861913:0:14240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14240:1869066311672832:192.168.204.51@tcp:104: 00000100:00100000:1.0:1782480928.861990:0:14240:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d49339b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782480928.865229:0:14240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14240:1869066311672832:192.168.204.51@tcp:104: 00010000:00010000:1.0:1782480928.865257:0:14240:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024ed4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480928.867326:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480928.868037:0:14224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291759360 00000100:00100000:2.0:1782480928.868046:0:14224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291759360 00010000:00010000:2.0:1782480928.868086:0:14224:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024e3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcbb expref: 6 pid: 15901 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480928.868131:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:2.0:1782480928.868141:0:14224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75542d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+6:2367:x1869066291759360:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480928.868158:0:14224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480928.868165:0:14224:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024e3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcbb expref: 6 pid: 15901 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.868179:0:14224:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024e3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcbb expref: 6 pid: 15901 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.868216:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572200/0x3dc3ebf33c024e3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcbb expref: 6 pid: 15901 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.868232:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d45d62d00) 00010000:00010000:2.0:1782480928.868238:0:14224:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024ed4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.868247:0:14224:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024ed4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.868254:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024ed4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.868391:0:14224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480928.868455:0:14224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75542d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+5:2367:x1869066291759360:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 315us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480928.868464:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00010000:00010000:3.0:1782480928.870339:0:14240:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024ed4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480928.870356:0:14240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024ed4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480928.870389:0:14240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024edb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480928.870402:0:14240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024edb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480928.870420:0:14240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024edb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480928.872575:0:14240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1782480928.872592:0:14240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024ed4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480928.872625:0:14240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024ed4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480928.872632:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024ed4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480928.872638:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572400 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480928.872643:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024ed4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480928.872650:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024ed4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480928.872664:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d45d62d00) 00010000:00010000:3.0:1782480928.872667:0:14240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480928.872671:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024ed4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480928.872677:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c024ed4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782480928.872697:0:14240:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004778cd56 reply state 00000000f26254f1 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024edb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480928.872707:0:14240:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782480928.873159:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+10:14399:x1869066291759232:12345-192.168.204.51@tcp:36:lfs.0 Request processed in 12120us (12435us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1782480928.873168:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00010000:00010000:1.0:1782480928.876391:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024edb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.876407:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024edb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.876416:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024edb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.876440:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1e200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480928.876445:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024edb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.876453:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024edb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.876470:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b6d4b781c00) 00010000:00010000:1.0:1782480928.876473:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480928.876477:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024edb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480928.876484:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024edb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480928.988719:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480928.988870:0:15901:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291759488 00000100:00100000:2.0:1782480928.988882:0:15901:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291759488 00000100:00100000:2.0:1782480928.988948:0:15901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:2.0:1782480928.988958:0:15901:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+9:14407:x1869066291759488:12345-192.168.204.51@tcp:101:lctl.0 00010000:00010000:2.0:1782480928.988986:0:15901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480928.989011:0:15901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9000/0x3dc3ebf33c024ee2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fce5 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.989095:0:15901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024ee9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.989143:0:15901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.989156:0:15901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480928.989219:0:15901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782480928.989223:0:15901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480928.989263:0:15901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.989288:0:15901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9000/0x3dc3ebf33c024ee2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fce5 expref: 11 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.989307:0:15901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9600/0x3dc3ebf33c024ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fce5 expref: 10 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480928.989315:0:15901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d45d62e00) 00010000:00010000:2.0:1782480928.989318:0:15901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782480928.989321:0:15901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9600, rc 0) 00000100:00100000:2.0:1782480928.989469:0:15901:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+10:14407:x1869066291759488:12345-192.168.204.51@tcp:101:lctl.0 Request processed in 511us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480928.989477:0:15901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:0.0:1782480929.015088:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311673344:0@lo:400:kworker.0 00000100:00100000:0.0:1782480929.015160:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480929.015222:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782480929.015228:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311673216:0@lo:400:kworker.0 00000100:00100000:0.0:1782480929.015275:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480929.015409:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311673088:0@lo:400:kworker.0 00000100:00100000:3.0:1782480929.015439:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480929.015472:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311673600:0@lo:400:kworker.0 00000100:00100000:3.0:1782480929.015494:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480929.015512:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782480929.015517:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3318:1869066311672960:0@lo:400:kworker.0 00000100:00100000:3.0:1782480929.015547:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480929.015569:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1869066311673472:0@lo:400:kworker.0 00000100:00100000:3.0:1782480929.015588:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480929.015639:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311673216 00000100:00100000:3.0:1782480929.015647:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311673216 00000100:00100000:3.0:1782480929.015695:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311673088 00000100:00100000:3.0:1782480929.015698:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311673088 00000100:00100000:3.0:1782480929.015719:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782480929.015727:0:14873:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311673216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480929.016063:0:14873:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1869066311673216:12345-0@lo:400:kworker.0 Request processed in 336us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480929.016181:0:14231:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311672960 00000100:00100000:1.0:1782480929.016186:0:14231:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311672960 00000100:00100000:1.0:1782480929.016216:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1782480929.016224:0:14231:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f31b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:3318:x1869066311672960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480929.016265:0:14231:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f31b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:3318:x1869066311672960:12345-0@lo:400:kworker.0 Request processed in 43us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480929.016271:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1782480929.016304:0:16181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782480929.016312:0:16181:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311673088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480929.016342:0:16181:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311673088:12345-0@lo:400:kworker.0 Request processed in 31us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480929.016348:0:16181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782480929.016437:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782480929.016464:0:14239:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311673344 00000100:00100000:3.0:1782480929.016469:0:14239:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311673344 00000100:00100000:3.0:1782480929.016495:0:14239:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311673600 00000100:00100000:3.0:1782480929.016499:0:14239:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311673600 00000100:00100000:3.0:1782480929.016514:0:14239:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311673472 00000100:00100000:3.0:1782480929.016516:0:14239:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311673472 00000100:00100000:3.0:1782480929.016535:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782480929.016543:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311673728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480929.016544:0:14239:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311673344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480929.016590:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480929.016598:0:14239:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311673344:12345-0@lo:400:kworker.0 Request processed in 55us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480929.016616:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782480929.016630:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480929.016635:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782480929.016640:0:3315:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7f2d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311673856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480929.016652:0:14239:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869066311673600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480929.016687:0:14239:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869066311673600:12345-0@lo:400:kworker.0 Request processed in 38us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480929.016693:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782480929.016705:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782480929.016712:0:14239:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869066311673472:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782480929.017585:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782480929.017591:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782480929.017594:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782480929.017649:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3316:1869066311673216:0@lo:400:kworker.0 00000100:00100000:0.0:1782480929.017662:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311673344:0@lo:400:kworker.0 00000100:00100000:0.0:1782480929.017726:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3318:1869066311672960:0@lo:400:kworker.0 00000100:00100000:1.0:1782480929.017836:0:14878:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311673728 00000100:00100000:1.0:1782480929.017845:0:14878:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311673728 00000100:00100000:1.0:1782480929.017889:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782480929.017897:0:14878:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311673728:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480929.018023:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311673088:0@lo:400:kworker.0 00002000:00000024:1.0:1782480929.018035:0:14878:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480929.018036:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311673600:0@lo:400:kworker.0 00000100:00100000:2.0:1782480929.018041:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480929.018093:0:14877:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1782480929.018093:0:14878:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311673728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 195us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480929.018106:0:14877:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1782480929.018107:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782480929.018128:0:14878:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311673856 00000100:00100000:1.0:1782480929.018132:0:14878:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311673856 00000100:00100000:2.0:1782480929.018147:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311673728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480929.018153:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782480929.018161:0:14878:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311673856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480929.018183:0:14878:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480929.018342:0:14239:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869066311673472:12345-0@lo:400:kworker.0 Request processed in 1628us (2750us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480929.018350:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782480929.018578:0:14878:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1869066311673856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 417us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480929.018585:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782480929.018622:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1869066311673472:0@lo:400:kworker.0 00000100:00100000:2.0:1782480929.018980:0:3315:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7f2d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3315:1869066311673856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480929.019004:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480929.019141:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291759616 00000100:00100000:3.0:1782480929.019147:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291759616 00000100:00100000:3.0:1782480929.019220:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:3.0:1782480929.019228:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+5:14408:x1869066291759616:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1782480929.019242:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480929.019260:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1ec00/0x3dc3ebf33c024ef0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fcec expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.019326:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e000/0x3dc3ebf33c024ef7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.019340:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e000/0x3dc3ebf33c024ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.019350:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e000/0x3dc3ebf33c024ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480929.019423:0:14238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782480929.019427:0:14238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480929.019465:0:14238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e000/0x3dc3ebf33c024ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.019621:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1ec00/0x3dc3ebf33c024ef0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcec expref: 7 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.019641:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e000/0x3dc3ebf33c024ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcec expref: 6 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.019650:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d45d62e00) 00010000:00010000:3.0:1782480929.019653:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782480929.019656:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6ef1e000, rc 0) 00000100:00100000:3.0:1782480929.019709:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+6:14408:x1869066291759616:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 482us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480929.019715:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:0.0:1782480929.029553:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480929.033604:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291759744 00000100:00100000:3.0:1782480929.033628:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291759744 00000100:00100000:3.0:1782480929.033703:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:3.0:1782480929.033714:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+6:14408:x1869066291759744:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1782480929.033732:0:14240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480929.033769:0:14240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1ec00/0x3dc3ebf33c024efe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fcf3 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.033836:0:14240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f05 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.033849:0:14240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.033860:0:14240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.033893:0:14240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.033901:0:14240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.033908:0:14240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.034025:0:14240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f000/0x3dc3ebf33c024f13 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.034033:0:14240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f000/0x3dc3ebf33c024f13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.034039:0:14240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f000/0x3dc3ebf33c024f13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480929.034202:0:14240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1782480929.034208:0:14240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480929.034233:0:14240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f000/0x3dc3ebf33c024f13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.034245:0:14240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.034252:0:14240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f05 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.034259:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.034274:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1fa00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480929.034278:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.034285:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f05 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.034296:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d45d62e00) 00010000:00010000:3.0:1782480929.034300:0:14240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480929.034304:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.034310:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.034323:0:14240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.034328:0:14240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.034335:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.034340:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1e200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480929.034343:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.034349:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.034367:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b6d4b781100) 00010000:00010000:3.0:1782480929.034369:0:14240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480929.034372:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f0c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.034378:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.034412:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1ec00/0x3dc3ebf33c024efe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcf3 expref: 8 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.034644:0:14240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f000/0x3dc3ebf33c024f13 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcf3 expref: 7 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.034651:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b6d4b781400) 00010000:00010000:3.0:1782480929.034653:0:14240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782480929.034656:0:14240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6ef1f000, rc 0) 00000100:00100000:3.0:1782480929.035107:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+7:14408:x1869066291759744:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1017us (5239us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480929.035118:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:2.0:1782480929.038623:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480929.038823:0:15901:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291760000 00000100:00100000:0.0:1782480929.038833:0:15901:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291760000 00000100:00100000:0.0:1782480929.039152:0:15901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:0.0:1782480929.039164:0:15901:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+7:14408:x1869066291760000:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1782480929.039192:0:15901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480929.039214:0:15901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c024f1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fcfa expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480929.039328:0:15901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1782480929.039458:0:15901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c024f1a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcfa expref: 9 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.039474:0:15901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d45d62e00) 00010000:00010000:0.0:1782480929.039490:0:15901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782480929.039496:0:15901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c024f1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcfa expref: 9 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.039511:0:15901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2c600, rc 0) 00000100:00100000:0.0:1782480929.039572:0:15901:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+8:14408:x1869066291760000:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 411us (968us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1782480929.039580:0:15901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:0.0:1782480929.054153:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480929.055260:0:14239:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291760256 00000100:00100000:3.0:1782480929.055272:0:14239:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291760256 00000100:00100000:3.0:1782480929.055375:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:3.0:1782480929.055396:0:14239:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+8:14408:x1869066291760256:12345-192.168.204.51@tcp:36:lfs.0 00010000:00010000:3.0:1782480929.055454:0:14239:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480929.055481:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f000/0x3dc3ebf33c024f13 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fcf3 expref: 8 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.055528:0:14239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b6d4b781400) 00010000:00010000:3.0:1782480929.055540:0:14239:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782480929.055565:0:14239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1ec00/0x3dc3ebf33c024f28 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.055577:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1ec00/0x3dc3ebf33c024f28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.055587:0:14239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1ec00/0x3dc3ebf33c024f28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782480929.055880:0:14239:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005b879f56 reply state 000000001da1861a transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1ec00/0x3dc3ebf33c024f28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480929.055891:0:14239:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782480929.055905:0:14239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1782480929.056236:0:14239:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+9:14408:x1869066291760256:12345-192.168.204.51@tcp:36:lfs.0 Request processed in 596us (1846us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1782480929.056244:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00010000:00010000:2.0:1782480929.059120:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1ec00/0x3dc3ebf33c024f28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.059137:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1ec00/0x3dc3ebf33c024f28 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.059144:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1ec00/0x3dc3ebf33c024f28 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.059150:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1ec00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480929.059156:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1ec00/0x3dc3ebf33c024f28 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.059163:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1ec00/0x3dc3ebf33c024f28 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.059255:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b6d4b781100) 00010000:00010000:2.0:1782480929.059259:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1782480929.059264:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1ec00/0x3dc3ebf33c024f28 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.059270:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1ec00/0x3dc3ebf33c024f28 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480929.059414:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480929.059593:0:14241:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291760512 00000100:00100000:3.0:1782480929.059664:0:14241:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291760512 00000100:00100000:3.0:1782480929.059786:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:3.0:1782480929.059796:0:14241:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+8:14408:x1869066291760512:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1782480929.060067:0:14241:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+9:14408:x1869066291760512:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 270us (656us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1782480929.060075:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:1.0:1782480929.068587:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480929.072878:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291760768 00000100:00100000:3.0:1782480929.072909:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291760768 00000100:00100000:3.0:1782480929.072980:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:3.0:1782480929.072990:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+9:14408:x1869066291760768:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1782480929.073014:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480929.073035:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f000/0x3dc3ebf33c024f2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fd01 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073103:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f36 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073116:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073127:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073140:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073147:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073154:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480929.073282:0:14238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1782480929.073369:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073377:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f36 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073394:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073400:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1e200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480929.073405:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073413:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f36 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073425:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d45d62e00) 00010000:00010000:3.0:1782480929.073429:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480929.073433:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073439:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073454:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073460:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f3d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073466:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073472:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1fa00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480929.073475:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073491:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f3d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073499:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b6d4b781400) 00010000:00010000:3.0:1782480929.073502:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480929.073505:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f3d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073512:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073548:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f000/0x3dc3ebf33c024f2f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd01 expref: 11 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073559:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d45d62e00) 00010000:00010000:3.0:1782480929.073561:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782480929.073565:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f000/0x3dc3ebf33c024f2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd01 expref: 11 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.073575:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6ef1f000, rc 0) 00000100:00100000:3.0:1782480929.073660:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+10:14408:x1869066291760768:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 671us (5082us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1782480929.073669:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00010000:00010000:3.0:1782480929.078975:0:16259:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480929.084712:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480929.091888:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291760896 00000100:00100000:0.0:1782480929.091903:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291760896 00000100:00100000:0.0:1782480929.091989:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:0.0:1782480929.092000:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+10:14408:x1869066291760896:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1782480929.092025:0:14240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480929.092047:0:14240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c024f4b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fd08 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.092130:0:14240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c024f52 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.092145:0:14240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c024f52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.092159:0:14240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c024f52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480929.092227:0:14240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1782480929.092231:0:14240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480929.092277:0:14240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c024f52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.092305:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c024f4b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd08 expref: 12 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.092323:0:14240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c024f52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd08 expref: 11 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.092331:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b6d4a16b600) 00010000:00010000:0.0:1782480929.092335:0:14240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782480929.092338:0:14240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2ce00, rc 0) 00000100:00100000:0.0:1782480929.092685:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+11:14408:x1869066291760896:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 685us (7979us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480929.092692:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:1.0:1782480929.096645:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480929.096993:0:14242:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291761024 00000100:00100000:0.0:1782480929.097004:0:14242:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291761024 00000100:00100000:0.0:1782480929.097068:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:0.0:1782480929.097079:0:14242:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+11:14408:x1869066291761024:12345-192.168.204.51@tcp:37:lfs.0 00000100:00100000:0.0:1782480929.102635:0:14242:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+11:14408:x1869066291761024:12345-192.168.204.51@tcp:37:lfs.0 Request processed in 5546us (5987us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480929.102658:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:0.0:1782480929.109572:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480929.110641:0:14241:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291761280 00000100:00100000:3.0:1782480929.110653:0:14241:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291761280 00000100:00100000:3.0:1782480929.111662:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:3.0:1782480929.111678:0:14241:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473c6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+11:14408:x1869066291761280:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1782480929.111991:0:14241:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473c6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+12:14408:x1869066291761280:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 317us (2427us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1782480929.112001:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:1.0:1782480929.173224:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480929.173372:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291761408 00000100:00100000:3.0:1782480929.173384:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291761408 00000100:00100000:3.0:1782480929.173458:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:3.0:1782480929.173469:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+10:14414:x1869066291761408:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1782480929.173490:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480929.173509:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f000/0x3dc3ebf33c024f59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fd0f expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.173573:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.173587:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.173599:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.173626:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.173633:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.173638:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.173741:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1ea00/0x3dc3ebf33c024f6e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.173806:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1ea00/0x3dc3ebf33c024f6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.173814:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1ea00/0x3dc3ebf33c024f6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480929.173850:0:14238:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1782480929.173854:0:14238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480929.174333:0:14238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1ea00/0x3dc3ebf33c024f6e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.174355:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.174361:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f60 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.174368:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.174373:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1fa00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480929.174378:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.174384:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.174410:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d45d62e00) 00010000:00010000:2.0:1782480929.174413:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480929.174418:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.174424:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fa00/0x3dc3ebf33c024f60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.174439:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.174445:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.174450:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.174461:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1e200 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480929.174464:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.174470:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.174478:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b6d4b781400) 00010000:00010000:2.0:1782480929.174480:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480929.174483:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f67 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.174489:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e200/0x3dc3ebf33c024f67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.174525:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f000/0x3dc3ebf33c024f59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd0f expref: 12 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.174538:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1ea00/0x3dc3ebf33c024f6e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd0f expref: 11 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.174545:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b6d4a16b600) 00010000:00010000:2.0:1782480929.174547:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782480929.174550:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6ef1ea00, rc 0) 00000100:00100000:2.0:1782480929.174626:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+11:14414:x1869066291761408:12345-192.168.204.51@tcp:101:bash.0 Request processed in 1158us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480929.174634:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:2.0:1782480929.179108:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480929.179215:0:14239:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291761664 00000100:00100000:3.0:1782480929.179225:0:14239:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291761664 00000100:00100000:3.0:1782480929.179285:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:3.0:1782480929.179296:0:14239:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+11:14414:x1869066291761664:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1782480929.179318:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480929.179340:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e600/0x3dc3ebf33c024f75 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fd16 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.179470:0:14239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e800/0x3dc3ebf33c024f7c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.179484:0:14239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c024f52 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd08 expref: 11 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.179493:0:14239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e800/0x3dc3ebf33c024f7c lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.179526:0:14239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c024f52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd08 expref: 11 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.179540:0:14239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c024f52 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd08 expref: 11 pid: 14240 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480929.179561:0:14239:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75541880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14239:1869066311673984:192.168.204.51@tcp:104: 00000100:00100000:3.0:1782480929.179671:0:14239:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6c42611000 going to sleep for 11 seconds 00000100:00100000:3.0:1782480929.183722:0:14239:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75541880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14239:1869066311673984:192.168.204.51@tcp:104: 00010000:00010000:3.0:1782480929.183795:0:14239:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e800/0x3dc3ebf33c024f7c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480929.185345:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480929.185440:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291761792 00000100:00100000:1.0:1782480929.185450:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291761792 00010000:00010000:1.0:1782480929.185493:0:14225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c024f52 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd08 expref: 12 pid: 14240 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480929.185538:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:1.0:1782480929.185547:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+12:2366:x1869066291761792:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480929.185563:0:14225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480929.185583:0:14225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c024f52 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd08 expref: 12 pid: 14240 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480929.185597:0:14225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c024f52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd08 expref: 12 pid: 14240 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480929.185632:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c024f52 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd08 expref: 12 pid: 14240 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480929.185650:0:14225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b6d4a16b600) 00010000:00010000:1.0:1782480929.185655:0:14225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e800/0x3dc3ebf33c024f7c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480929.185665:0:14225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e800/0x3dc3ebf33c024f7c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480929.185672:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e800/0x3dc3ebf33c024f7c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480929.185702:0:14225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480929.185805:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+11:2366:x1869066291761792:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 258us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480929.185814:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00010000:00010000:3.0:1782480929.186356:0:14239:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e800/0x3dc3ebf33c024f7c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.186365:0:14239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e800/0x3dc3ebf33c024f7c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.186388:0:14239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fc00/0x3dc3ebf33c024f83 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.186398:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fc00/0x3dc3ebf33c024f83 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.186406:0:14239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fc00/0x3dc3ebf33c024f83 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.187215:0:14239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f800/0x3dc3ebf33c024f8a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.187226:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f800/0x3dc3ebf33c024f8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.187235:0:14239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f800/0x3dc3ebf33c024f8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480929.187257:0:14239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1782480929.187283:0:14239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e800/0x3dc3ebf33c024f7c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.187290:0:14239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e800/0x3dc3ebf33c024f7c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.187297:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e800/0x3dc3ebf33c024f7c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.187302:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1e800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480929.187306:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e800/0x3dc3ebf33c024f7c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.187313:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e800/0x3dc3ebf33c024f7c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.187322:0:14239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b6d4a16b600) 00010000:00010000:3.0:1782480929.187325:0:14239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480929.187328:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e800/0x3dc3ebf33c024f7c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.187334:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e800/0x3dc3ebf33c024f7c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782480929.187344:0:14239:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000042086bac reply state 0000000022ae3166 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fc00/0x3dc3ebf33c024f83 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480929.187352:0:14239:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782480929.187382:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e600/0x3dc3ebf33c024f75 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd16 expref: 14 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.187405:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f800/0x3dc3ebf33c024f8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd16 expref: 13 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.187411:0:14239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d4b781900) 00010000:00010000:3.0:1782480929.187414:0:14239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1782480929.187415:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6ef1f800, rc 0) 00000100:00100000:3.0:1782480929.188297:0:14239:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+14:14414:x1869066291761664:12345-192.168.204.51@tcp:101:bash.0 Request processed in 8996us (9192us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1782480929.188307:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00010000:00010000:3.0:1782480929.200480:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fc00/0x3dc3ebf33c024f83 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.200498:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fc00/0x3dc3ebf33c024f83 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.200507:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fc00/0x3dc3ebf33c024f83 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.200514:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1fc00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480929.200520:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fc00/0x3dc3ebf33c024f83 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.200529:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fc00/0x3dc3ebf33c024f83 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.200545:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9b6d4b781600) 00010000:00010000:3.0:1782480929.200549:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480929.200554:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fc00/0x3dc3ebf33c024f83 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.200575:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fc00/0x3dc3ebf33c024f83 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480929.205733:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480929.206257:0:15901:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291761920 00000100:00100000:2.0:1782480929.206269:0:15901:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291761920 00000100:00100000:2.0:1782480929.206334:0:15901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:2.0:1782480929.206345:0:15901:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+13:14414:x1869066291761920:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1782480929.206370:0:15901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480929.206388:0:15901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8c00/0x3dc3ebf33c024f98 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fd1d expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.206456:0:15901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024f9f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.206469:0:15901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024f9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.206480:0:15901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024f9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480929.206521:0:15901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782480929.206526:0:15901:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480929.206545:0:15901:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024f9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.206555:0:15901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024f9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.206577:0:15901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8c00/0x3dc3ebf33c024f98 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd1d expref: 15 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.206594:0:15901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024f9f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd1d expref: 14 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.206632:0:15901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d4b781900) 00010000:00010000:2.0:1782480929.206635:0:15901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782480929.206639:0:15901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e8800, rc 0) 00000100:00100000:2.0:1782480929.206701:0:15901:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+14:14414:x1869066291761920:12345-192.168.204.51@tcp:101:bash.0 Request processed in 357us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480929.206708:0:15901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:2.0:1782480929.225683:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480929.225900:0:14242:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291762176 00000100:00100000:0.0:1782480929.225910:0:14242:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291762176 00000100:00100000:0.0:1782480929.225973:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:0.0:1782480929.225984:0:14242:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+14:14414:x1869066291762176:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:0.0:1782480929.226356:0:14242:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+15:14414:x1869066291762176:12345-192.168.204.51@tcp:35:bash.0 Request processed in 372us (680us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1782480929.226364:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:0.0:1782480929.330301:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480929.330438:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291762432 00000100:00100000:3.0:1782480929.330448:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291762432 00000100:00100000:3.0:1782480929.330508:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:3.0:1782480929.330519:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+15:14424:x1869066291762432:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1782480929.330544:0:14240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480929.330564:0:14240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fc00/0x3dc3ebf33c024fa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fd24 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480929.330696:0:14240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1782480929.331330:0:14240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fc00/0x3dc3ebf33c024fa6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd24 expref: 17 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.331346:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b6d45d62e00) 00010000:00010000:3.0:1782480929.331349:0:14240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782480929.331353:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1fc00/0x3dc3ebf33c024fa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd24 expref: 17 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.331369:0:14240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6ef1fc00, rc 0) 00000100:00100000:3.0:1782480929.331548:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+16:14424:x1869066291762432:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1029us (1252us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1782480929.331557:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:1.0:1782480929.336080:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480929.336135:0:14242:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291762688 00000100:00100000:0.0:1782480929.336145:0:14242:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291762688 00000100:00100000:0.0:1782480929.336200:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:0.0:1782480929.336211:0:14242:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+16:14424:x1869066291762688:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1782480929.337209:0:14242:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+17:14424:x1869066291762688:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 995us (1133us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1782480929.337217:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000040:00080000:2.0:1782480929.337685:0:14271:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1782480929.392071:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480929.392185:0:15901:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291762944 00000100:00100000:0.0:1782480929.392195:0:15901:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291762944 00000100:00100000:0.0:1782480929.392255:0:15901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:0.0:1782480929.392266:0:15901:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+17:14427:x1869066291762944:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1782480929.392298:0:15901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480929.392315:0:15901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d200/0x3dc3ebf33c024fb4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fd2b expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.392427:0:15901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c024fbb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.392440:0:15901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c024fbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.392451:0:15901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c024fbb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480929.392688:0:15901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782480929.392856:0:15901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d200/0x3dc3ebf33c024fb4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd2b expref: 20 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.392876:0:15901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c024fbb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd2b expref: 19 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.392884:0:15901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d4b781900) 00010000:00010000:0.0:1782480929.392898:0:15901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782480929.392902:0:15901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2d600, rc 0) 00000100:00100000:0.0:1782480929.392967:0:15901:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+19:14427:x1869066291762944:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 703us (904us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1782480929.392974:0:15901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:1.0:1782480929.396234:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480929.396282:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480929.396346:0:14239:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291763200 00000100:00100000:0.0:1782480929.396356:0:14239:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291763200 00000100:00100000:2.0:1782480929.396381:0:14224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291763072 00000100:00100000:2.0:1782480929.396387:0:14224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291763072 00000100:00100000:0.0:1782480929.396417:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:0.0:1782480929.396428:0:14239:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+20:14427:x1869066291763200:12345-192.168.204.51@tcp:54:lfs.0 00000100:00100000:2.0:1782480929.396449:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:2.0:1782480929.396459:0:14224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+20:2366:x1869066291763072:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480929.396472:0:14224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480929.396493:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c024fbb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd2b expref: 20 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.396503:0:14239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024fc9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.396513:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d4b781900) 00010000:00010000:2.0:1782480929.396705:0:14224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480929.396788:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.396802:0:14239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480929.396807:0:14224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+19:2366:x1869066291763072:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 347us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480929.396818:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00010000:00010000:0.0:1782480929.396835:0:14239:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.396859:0:14239:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024fc9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.396865:0:14239:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.396870:0:14239:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c800 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480929.396875:0:14239:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.396882:0:14239:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024fc9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.396903:0:14239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d4b781900) 00010000:00010000:0.0:1782480929.396906:0:14239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782480929.396909:0:14239:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024fc9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.396915:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024fc9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480929.396954:0:14239:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+18:14427:x1869066291763200:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 528us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480929.396961:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:2.0:1782480929.399189:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480929.399267:0:14241:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291763456 00000100:00100000:3.0:1782480929.399276:0:14241:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291763456 00000100:00100000:3.0:1782480929.399329:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:3.0:1782480929.399353:0:14241:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+18:14427:x1869066291763456:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1782480929.399581:0:14241:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+19:14427:x1869066291763456:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 229us (399us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1782480929.399589:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:1.0:1782480929.677322:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480929.677512:0:15901:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291763712 00000100:00100000:0.0:1782480929.677524:0:15901:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291763712 00000100:00100000:0.0:1782480929.677607:0:15901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:0.0:1782480929.677618:0:15901:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+19:14458:x1869066291763712:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:0.0:1782480929.677654:0:15901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480929.677687:0:15901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024fd0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fd32 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.677823:0:15901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d200/0x3dc3ebf33c024fd7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.677838:0:15901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d200/0x3dc3ebf33c024fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.677849:0:15901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d200/0x3dc3ebf33c024fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480929.677861:0:15901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782480929.678015:0:15901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024fd0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd32 expref: 22 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.678035:0:15901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d200/0x3dc3ebf33c024fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd32 expref: 21 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.678044:0:15901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d4b781900) 00010000:00010000:0.0:1782480929.678047:0:15901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782480929.678050:0:15901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2d200, rc 0) 00000100:00100000:0.0:1782480929.678117:0:15901:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+21:14458:x1869066291763712:12345-192.168.204.51@tcp:101:cat.0 Request processed in 501us (805us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1782480929.678124:0:15901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:1.0:1782480929.686152:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480929.686205:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480929.686246:0:14242:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291763968 00000100:00100000:0.0:1782480929.686257:0:14242:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291763968 00000100:00100000:2.0:1782480929.686274:0:14223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291764096 00000100:00100000:2.0:1782480929.686281:0:14223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291764096 00000100:00100000:2.0:1782480929.686353:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:2.0:1782480929.686364:0:14223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+22:2368:x1869066291764096:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480929.686381:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782480929.686386:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:0.0:1782480929.686398:0:14242:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+22:14458:x1869066291763968:12345-192.168.204.51@tcp:35:cat.0 00010000:00010000:2.0:1782480929.686411:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d200/0x3dc3ebf33c024fd7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd32 expref: 22 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.686433:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d4b781900) 00010000:00010000:2.0:1782480929.686438:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480929.686497:0:14223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+21:2368:x1869066291764096:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 136us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480929.686505:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:0.0:1782480929.686742:0:14242:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+21:14458:x1869066291763968:12345-192.168.204.51@tcp:35:cat.0 Request processed in 347us (601us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1782480929.686788:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:2.0:1782480929.758108:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480929.758207:0:14239:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291764352 00000100:00100000:0.0:1782480929.758235:0:14239:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291764352 00000100:00100000:0.0:1782480929.758303:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:0.0:1782480929.758313:0:14239:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+21:14464:x1869066291764352:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:0.0:1782480929.758341:0:14239:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480929.758362:0:14239:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024fe5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fd39 expref: -99 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.758476:0:14239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024fec lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.758492:0:14239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f800/0x3dc3ebf33c024f8a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd16 expref: 22 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.758501:0:14239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024f9f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd1d expref: 22 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.758509:0:14239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024fec lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.758544:0:14239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024f9f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd1d expref: 22 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.758558:0:14239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024f9f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd1d expref: 22 pid: 15901 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480929.758610:0:14239:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14239:1869066311674112:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480929.758730:0:14239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f800/0x3dc3ebf33c024f8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd16 expref: 22 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.758740:0:14239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f800/0x3dc3ebf33c024f8a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd16 expref: 22 pid: 14239 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480929.758792:0:14239:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7b28c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14239:1869066311674240:192.168.204.51@tcp:104: 00000100:00100000:0.0:1782480929.758827:0:14239:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d43987000 going to sleep for 11 seconds 00000100:00100000:0.0:1782480929.760480:0:14239:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14239:1869066311674112:192.168.204.51@tcp:104: 00000100:00100000:2.0:1782480929.767947:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480929.768376:0:14224:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291764480 00000100:00100000:3.0:1782480929.768387:0:14224:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291764480 00010000:00010000:3.0:1782480929.768425:0:14224:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024f9f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd1d expref: 23 pid: 15901 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480929.768466:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1782480929.768476:0:14224:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47edec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+23:2366:x1869066291764480:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480929.768490:0:14224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480929.768497:0:14224:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024f9f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd1d expref: 23 pid: 15901 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.768509:0:14224:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024f9f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd1d expref: 23 pid: 15901 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.768532:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c024f9f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd1d expref: 23 pid: 15901 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.768548:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d4b781900) 00010000:00010000:3.0:1782480929.768553:0:14224:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024fec lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.768562:0:14224:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024fec lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.768586:0:14224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480929.768654:0:14224:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47edec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+22:2366:x1869066291764480:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 178us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480929.768663:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:0.0:1782480929.769345:0:14239:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7b28c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14239:1869066311674240:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480929.769374:0:14239:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024fec lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480929.769657:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480929.769777:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291764608 00000100:00100000:3.0:1782480929.769783:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291764608 00010000:00010000:3.0:1782480929.769815:0:14225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f800/0x3dc3ebf33c024f8a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd16 expref: 22 pid: 14239 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480929.769841:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:3.0:1782480929.769848:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75542d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+22:2366:x1869066291764608:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480929.769865:0:14225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480929.769872:0:14225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f800/0x3dc3ebf33c024f8a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd16 expref: 22 pid: 14239 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.769884:0:14225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f800/0x3dc3ebf33c024f8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd16 expref: 22 pid: 14239 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.769900:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f800/0x3dc3ebf33c024f8a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd16 expref: 22 pid: 14239 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.769912:0:14225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d4b781900) 00010000:00010000:3.0:1782480929.769916:0:14225:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024fec lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.769924:0:14225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024fec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.769942:0:14225:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024fec lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480929.769962:0:14225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480929.769996:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75542d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+21:2366:x1869066291764608:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 147us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480929.770003:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00010000:00010000:0.0:1782480929.772057:0:14239:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024fec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.772074:0:14239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024fec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480929.772098:0:14239:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782480929.772269:0:14239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c024fe5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd39 expref: 22 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.772302:0:14239:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2dc00/0x3dc3ebf33c024fec lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd39 expref: 21 pid: 14239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.772322:0:14239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d4b781900) 00010000:00010000:0.0:1782480929.772325:0:14239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782480929.772328:0:14239:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2dc00, rc 0) 00000100:00100000:0.0:1782480929.772389:0:14239:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+21:14464:x1869066291764352:12345-192.168.204.51@tcp:101:dd.0 Request processed in 14077us (14290us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1782480929.772397:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:3.0:1782480929.779238:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480929.780542:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291764864 00000100:00100000:1.0:1782480929.780570:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291764864 00000100:00100000:1.0:1782480929.780648:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:1.0:1782480929.780670:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+21:14464:x1869066291764864:12345-192.168.204.51@tcp:36:dd.0 00010000:00010000:1.0:1782480929.781604:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024ffa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480929.781623:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024ffa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480929.781634:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024ffa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782480929.781688:0:14238:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1782480929.781727:0:14238:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000376dfa88 reply state 00000000adb396ba transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024ffa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480929.781736:0:14238:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782480929.783602:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+24:14464:x1869066291764864:12345-192.168.204.51@tcp:36:dd.0 Request processed in 2924us (4353us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1782480929.783615:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00000020:00080000:1.0:1782480929.783622:0:14238:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782480929.788477:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024ffa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.788496:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024ffa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.788504:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024ffa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.788511:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572c00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480929.788517:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024ffa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.788524:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024ffa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.788543:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d4b781900) 00010000:00010000:2.0:1782480929.788573:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480929.788580:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024ffa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.788587:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c024ffa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480929.791503:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480929.791781:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291764992 00000100:00100000:0.0:1782480929.791791:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291764992 00000100:00100000:0.0:1782480929.791866:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:0.0:1782480929.791877:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+23:14464:x1869066291764992:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:0.0:1782480929.791905:0:14240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480929.791925:0:14240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c025001 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fd40 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.791980:0:14240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c025001 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd40 expref: 24 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.791995:0:14240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c025001 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd40 expref: 24 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480929.792011:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d4b781900) 00010000:00010000:0.0:1782480929.792015:0:14240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782480929.792017:0:14240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2d600, rc 0) 00000100:00100000:0.0:1782480929.792072:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+24:14464:x1869066291764992:12345-192.168.204.51@tcp:101:dd.0 Request processed in 198us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480929.792093:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:1.0:1782480929.813536:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480929.813646:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291765248 00000100:00100000:3.0:1782480929.813655:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291765248 00000100:00100000:2.0:1782480929.814048:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:2.0:1782480929.814061:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+24:14464:x1869066291765248:12345-192.168.204.51@tcp:103:dd.0 00010000:00010000:2.0:1782480929.814076:0:14225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480929.814101:0:14225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2d600/0x3dc3ebf33c025001 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd40 expref: 24 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480929.814120:0:14225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d4b781900) 00010000:00010000:2.0:1782480929.814124:0:14225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480929.814177:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+23:14464:x1869066291765248:12345-192.168.204.51@tcp:103:dd.0 Request processed in 120us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480929.814185:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:3.0:1782480929.816232:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480929.816404:0:15901:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291765376 00000100:00100000:1.0:1782480929.816414:0:15901:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291765376 00000100:00100000:1.0:1782480929.816473:0:15901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:1.0:1782480929.816482:0:15901:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+23:14464:x1869066291765376:12345-192.168.204.51@tcp:58:dd.0 00010000:00010000:1.0:1782480929.816579:0:15901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c025008 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480929.816607:0:15901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c025008 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480929.816631:0:15901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c025008 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782480929.817568:0:15901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782480929.817725:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1782480929.817819:0:15901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1782480929.817920:0:15901:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+23:14464:x1869066291765376:12345-192.168.204.51@tcp:58:dd.0 Request processed in 1435us (1692us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480929.817928:0:15901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:3.0:1782480929.821565:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480929.823337:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291765504 00000100:00100000:1.0:1782480929.823352:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291765504 00000100:00100000:1.0:1782480929.823421:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:1.0:1782480929.823433:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+23:14464:x1869066291765504:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:1.0:1782480929.823454:0:14240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480929.823474:0:14240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c02500f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fd47 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480929.823529:0:14240:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c025008 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480929.823540:0:14240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c02500f lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd47 expref: 24 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480929.823558:0:14240:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c025008 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480929.823571:0:14240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c02500f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd47 expref: 24 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480929.823618:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d4b781900) 00010000:00010000:1.0:1782480929.823621:0:14240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782480929.823624:0:14240:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c02500f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd47 expref: 24 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480929.823631:0:14240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572400, rc 0) 00000100:00100000:1.0:1782480929.823698:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+24:14464:x1869066291765504:12345-192.168.204.51@tcp:101:dd.0 Request processed in 268us (2143us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480929.823705:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 38 00010000:00010000:1.0:1782480930.103223:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782480930.359224:0:14271:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1782480930.359235:0:14271:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782480930.359291:0:14271:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1782480930.359298:0:14271:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1782480930.359421:0:14271:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d750fa680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14271:1869066311674368:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782480930.359670:0:14271:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f6ec780 going to sleep for 11 seconds 00000100:00100000:2.0:1782480930.370428:0:14271:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d750fa680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14271:1869066311674368:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782480930.374575:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480930.375659:0:14249:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291765632 00000100:00100000:1.0:1782480930.375672:0:14249:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291765632 00000100:00100000:1.0:1782480930.375791:0:14249:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:1.0:1782480930.375803:0:14249:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+24:14465:x1869066291765632:12345-192.168.204.51@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1782480930.376208:0:14249:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+24:14465:x1869066291765632:12345-192.168.204.51@tcp:900:lhsmtool_posix.0 Request processed in 406us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480930.376220:0:14249:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00080000:0.0:1782480930.376296:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480930.390322:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480930.390606:0:15901:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291765760 00000100:00100000:1.0:1782480930.390617:0:15901:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291765760 00000100:00100000:1.0:1782480930.390680:0:15901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:1.0:1782480930.390691:0:15901:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+24:14465:x1869066291765760:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782480930.390724:0:15901:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782480930.390876:0:15901:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+24:14465:x1869066291765760:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 186us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480930.390883:0:15901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:1.0:1782480930.400211:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480930.400510:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291765888 00000100:00100000:0.0:1782480930.400520:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291765888 00000100:00100000:0.0:1782480930.400590:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:0.0:1782480930.400601:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+24:14465:x1869066291765888:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1782480930.400672:0:14240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c025016 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.400690:0:14240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c025016 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.400703:0:14240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c025016 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.400718:0:14240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c02501d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.400724:0:14240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c02501d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.400731:0:14240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c02501d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.400782:0:14240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025024 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.400791:0:14240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.400797:0:14240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480930.400850:0:14240:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1782480930.400854:0:14240:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480930.400870:0:14240:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.400880:0:14240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c025016 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.400887:0:14240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c025016 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.400893:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c025016 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.400898:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c600 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480930.400903:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c025016 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.402105:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c025016 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.402122:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:0.0:1782480930.402125:0:14240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480930.402130:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c025016 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.402137:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c600/0x3dc3ebf33c025016 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.402155:0:14240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c02501d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.402176:0:14240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c02501d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.402182:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c02501d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.402187:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2ce00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480930.402191:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c02501d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.402197:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c02501d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.402204:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9b6d4a16b100) 00010000:00010000:0.0:1782480930.402206:0:14240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480930.402209:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c02501d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.402214:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c02501d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.402230:0:14240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025024 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.402235:0:14240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025024 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.402253:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025024 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.402258:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2da00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480930.402267:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025024 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.402273:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025024 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.402282:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d4b781900) 00010000:00010000:0.0:1782480930.402284:0:14240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480930.402287:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025024 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.402293:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025024 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480930.402394:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+24:14465:x1869066291765888:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 Request processed in 1791us (2188us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480930.402404:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:0.0:1782480930.419196:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480930.419305:0:15901:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291766144 00000100:00100000:1.0:1782480930.419315:0:15901:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291766144 00000100:00100000:1.0:1782480930.419389:0:15901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:1.0:1782480930.419399:0:15901:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+24:14465:x1869066291766144:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480930.419419:0:15901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480930.420365:0:15901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c02502b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fd4e expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.420470:0:15901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c025032 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.420485:0:15901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c025032 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.420496:0:15901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c025032 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480930.420507:0:15901:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1782480930.420617:0:15901:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c025032 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.420625:0:15901:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c025032 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.420631:0:15901:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c025032 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.420637:0:15901:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572c00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480930.420641:0:15901:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c025032 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.420648:0:15901:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c025032 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.420674:0:15901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d4b781900) 00010000:00010000:1.0:1782480930.420677:0:15901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782480930.420682:0:15901:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c025032 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.420688:0:15901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c025032 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.420729:0:15901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c02502b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd4e expref: 26 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.420740:0:15901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b6d5230f900) 00010000:00010000:1.0:1782480930.420742:0:15901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782480930.420784:0:15901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c02502b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd4e expref: 26 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.420796:0:15901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572000, rc 0) 00000100:00100000:1.0:1782480930.421098:0:15901:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+25:14465:x1869066291766144:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1699us (1910us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1782480930.421107:0:15901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:2.0:1782480930.430405:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480930.430888:0:14239:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291766272 00000100:00100000:1.0:1782480930.430900:0:14239:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291766272 00000100:00100000:1.0:1782480930.430996:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:1.0:1782480930.431007:0:14239:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+25:14465:x1869066291766272:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782480930.431069:0:14239:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782480930.431175:0:14239:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+25:14465:x1869066291766272:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 170us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480930.431192:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:2.0:1782480930.438094:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480930.438249:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291766528 00000100:00100000:3.0:1782480930.438258:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291766528 00000100:00100000:3.0:1782480930.438324:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:3.0:1782480930.438332:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+25:14465:x1869066291766528:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480930.438353:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480930.438371:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f800/0x3dc3ebf33c025040 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fd55 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782480930.439219:0:14238:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1782480930.439227:0:14238:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1782480930.439285:0:14238:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1782480930.439566:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c025047 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.439592:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c025047 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.439602:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c025047 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.439664:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1f800/0x3dc3ebf33c025040 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd55 expref: 28 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.439682:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c025047 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd55 expref: 27 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.439690:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:2.0:1782480930.439693:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782480930.439696:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e9400, rc 0) 00000100:00100000:2.0:1782480930.439807:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+27:14465:x1869066291766528:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1474us (1731us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1782480930.439816:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:3.0:1782480930.446544:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480930.447528:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291766784 00000100:00100000:0.0:1782480930.447540:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291766784 00000100:00100000:0.0:1782480930.447615:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:0.0:1782480930.447625:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+27:14465:x1869066291766784:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782480930.447707:0:14240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480930.447732:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9400/0x3dc3ebf33c025047 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd55 expref: 27 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.447768:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d45d62300) 00010000:00010000:0.0:1782480930.447780:0:14240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480930.450026:0:14240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025055 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.450070:0:14240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025055 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.450083:0:14240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025055 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.450113:0:14240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c02505c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc594ef47 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.450121:0:14240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c02505c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc594ef47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.450128:0:14240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c02505c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc594ef47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.450214:0:14240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025055 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.450222:0:14240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025055 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.450229:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025055 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.450234:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2da00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480930.450239:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025055 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.450245:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025055 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.450255:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b6d4a16b600) 00010000:00010000:0.0:1782480930.450265:0:14240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480930.450270:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025055 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.450277:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025055 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.450290:0:14240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c02505c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc594ef47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.450297:0:14240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c02505c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc594ef47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.450303:0:14240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c02505c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc594ef47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.450309:0:14240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2ce00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:0.0:1782480930.450311:0:14240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c02505c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc594ef47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.450317:0:14240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c02505c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc594ef47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.450325:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xc594ef47 (ffff9b6d4a16b100) 00010000:00010000:0.0:1782480930.450328:0:14240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480930.450331:0:14240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c02505c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc594ef47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.450336:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2ce00/0x3dc3ebf33c02505c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc594ef47 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480930.450442:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+26:14465:x1869066291766784:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 2812us (3902us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782480930.450456:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:3.0:1782480930.460816:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480930.461024:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291766912 00000100:00100000:2.0:1782480930.461034:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291766912 00000100:00100000:2.0:1782480930.461083:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:2.0:1782480930.461093:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+26:14465:x1869066291766912:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782480930.461124:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480930.461161:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9000/0x3dc3ebf33c025063 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fd5c expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.461195:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02506a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.461210:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02506a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.461220:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02506a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.461318:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e9000/0x3dc3ebf33c025063 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd5c expref: 28 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.461340:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d582e8800/0x3dc3ebf33c02506a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd5c expref: 27 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.461349:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:2.0:1782480930.461351:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782480930.461355:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d582e8800, rc 0) 00000100:00100000:2.0:1782480930.462663:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+27:14465:x1869066291766912:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1564us (1850us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480930.462675:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:2.0:1782480930.472083:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480930.472239:0:14239:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291767168 00000100:00100000:1.0:1782480930.472249:0:14239:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291767168 00000100:00100000:1.0:1782480930.472311:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:1.0:1782480930.472321:0:14239:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+27:14465:x1869066291767168:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782480930.472403:0:14239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c025071 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.472419:0:14239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c025071 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.472431:0:14239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c025071 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782480930.472920:0:14239:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1782480930.472933:0:14239:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 551314184832ns, next at 552314181506ns, rc = 0 00000004:00010000:1.0:1782480930.473016:0:14239:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004708a00a reply state 000000009ee6e5f9 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c025071 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480930.473026:0:14239:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782480930.473115:0:14239:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+29:14465:x1869066291767168:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 794us (1041us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1782480930.473123:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 46 00010000:00010000:1.0:1782480930.476852:0:3301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c025071 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.476870:0:3301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c025071 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.476897:0:3301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c025071 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.476903:0:3301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572000 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480930.476908:0:3301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c025071 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.476917:0:3301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c025071 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.476934:0:3301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:1.0:1782480930.476937:0:3301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782480930.476942:0:3301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c025071 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.476948:0:3301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c025071 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14239 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480930.477217:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480930.477277:0:15901:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291767296 00000100:00100000:1.0:1782480930.477287:0:15901:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291767296 00000100:00100000:1.0:1782480930.477340:0:15901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:1.0:1782480930.477349:0:15901:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+28:14465:x1869066291767296:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480930.477371:0:15901:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480930.477385:0:15901:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c025078 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fd63 expref: -99 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.477436:0:15901:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c025078 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd63 expref: 29 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.477461:0:15901:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c025078 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd63 expref: 29 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.477480:0:15901:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:1.0:1782480930.477483:0:15901:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782480930.477485:0:15901:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572c00, rc 0) 00000100:00100000:1.0:1782480930.477547:0:15901:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+29:14465:x1869066291767296:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 199us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480930.477555:0:15901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:3.0:1782480930.481364:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480930.481460:0:15624:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291767424 00000100:00100000:0.0:1782480930.481471:0:15624:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291767424 00000100:00100000:0.0:1782480930.481545:0:15624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:0.0:1782480930.481555:0:15624:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+5:2366:x1869066291767424:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1782480930.482044:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782480930.482283:0:15624:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+6:2366:x1869066291767424:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 727us (926us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1782480930.482291:0:15624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:3.0:1782480930.484832:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480930.484979:0:14241:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291767680 00000100:00100000:0.0:1782480930.484988:0:14241:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291767680 00000100:00100000:0.0:1782480930.485044:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:0.0:1782480930.485054:0:14241:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+29:14465:x1869066291767680:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782480930.485477:0:14241:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+30:14465:x1869066291767680:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 423us (652us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1782480930.485486:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:2.0:1782480930.488340:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480930.488417:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291767936 00000100:00100000:0.0:1782480930.488426:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291767936 00000100:00100000:0.0:1782480930.488484:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:0.0:1782480930.488495:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+30:14465:x1869066291767936:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782480930.488616:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+30:14465:x1869066291767936:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 123us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480930.488624:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:2.0:1782480930.493644:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480930.494559:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291768064 00000100:00100000:1.0:1782480930.494571:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291768064 00000100:00100000:1.0:1782480930.494679:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:1.0:1782480930.494690:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+30:14465:x1869066291768064:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480930.494711:0:14238:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480930.494741:0:14238:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c02507f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fd6a expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.494823:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c025086 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.494835:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c025086 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.494856:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c025086 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480930.494902:0:14238:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782480930.494934:0:14238:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c025086 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.494959:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572000/0x3dc3ebf33c02507f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd6a expref: 32 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.494978:0:14238:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c025086 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd6a expref: 31 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.494986:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:1.0:1782480930.494989:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1782480930.494993:0:14238:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d6e572800, rc 0) 00000100:00100000:1.0:1782480930.495056:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+31:14465:x1869066291768064:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 367us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480930.495063:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:3.0:1782480930.498604:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480930.499063:0:14876:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291768192 00000100:00100000:0.0:1782480930.499073:0:14876:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291768192 00000100:00100000:0.0:1782480930.499219:0:14876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:0.0:1782480930.499230:0:14876:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+6:2367:x1869066291768192:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782480930.499248:0:14876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480930.499271:0:14876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2e24077/0x3dc3ebf33c02508d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fd71 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782480930.499296:0:14876:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3e8022, blocks: 0x1 00010000:00010000:0.0:1782480930.499317:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1782480930.499322:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480930.499332:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2e24077/0x3dc3ebf33c02508d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd71 expref: 7 pid: 14876 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.499351:0:14876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d2e24077/0x3dc3ebf33c02508d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd71 expref: 7 pid: 14876 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.499364:0:14876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2ce00, rc 0) 00000100:00100000:0.0:1782480930.499526:0:14876:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+7:2367:x1869066291768192:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 297us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480930.499534:0:14876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:2.0:1782480930.503192:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480930.503326:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291768448 00000100:00100000:0.0:1782480930.503335:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291768448 00000100:00100000:0.0:1782480930.503392:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:0.0:1782480930.503401:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+31:14465:x1869066291768448:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782480930.503506:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+31:14465:x1869066291768448:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 105us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480930.503513:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:3.0:1782480930.506168:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480930.506351:0:14239:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291768576 00000100:00100000:0.0:1782480930.506361:0:14239:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291768576 00000100:00100000:0.0:1782480930.506406:0:14239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:0.0:1782480930.506416:0:14239:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+31:14465:x1869066291768576:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1782480930.545900:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:1.0:1782480930.545928:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000004:00080000:1.0:1782480930.545937:0:5829:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1782480930.545969:0:5829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1782480930.546228:0:14239:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+14:14465:x1869066291768576:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 Request processed in 39807us (40060us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480930.546238:0:14239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:1.0:1782480930.549312:0:3317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311674496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1782480930.549388:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480930.549549:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480930.549677:0:15624:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311674496 00000100:00100000:1.0:1782480930.549686:0:15624:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311674496 00000100:00100000:1.0:1782480930.549741:0:15624:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291768704 00000100:00100000:1.0:1782480930.549744:0:15624:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291768704 00000100:00100000:1.0:1782480930.549789:0:15624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782480930.549797:0:15624:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1869066311674496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1782480930.550065:0:15624:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1782480930.550069:0:15624:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1782480930.550084:0:15624:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782480930.550086:0:15624:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1782480930 -> 1782480930 00002000:00010000:1.0:1782480930.550088:0:15624:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782480930.550209:0:15624:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1869066311674496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 410us (818us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1782480930.550217:0:15624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782480930.550237:0:15624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:1.0:1782480930.550246:0:15624:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7b28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+7:2366:x1869066291768704:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1782480930.550304:0:15624:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7b28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+7:2366:x1869066291768704:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 Request processed in 60us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480930.550311:0:15624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000004:00080000:1.0:1782480930.550347:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b6d75540000/2, rc 0, transno 8589934595 00000100:00100000:1.0:1782480930.550353:0:3317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3317:1869066311674496:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1782480930.555941:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480930.556028:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291768960 00000100:00100000:0.0:1782480930.556038:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291768960 00000100:00100000:0.0:1782480930.556099:0:14240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:0.0:1782480930.556109:0:14240:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d750faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+14:14465:x1869066291768960:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782480930.556175:0:14240:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480930.556199:0:14240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572800/0x3dc3ebf33c025086 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd6a expref: 14 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.556216:0:14240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:0.0:1782480930.556221:0:14240:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480930.556247:0:14240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025094 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.556259:0:14240:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025094 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.556267:0:14240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025094 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782480930.556443:0:14240:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007da82276 reply state 000000008e225816 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025094 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480930.556464:0:14240:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782480930.556564:0:14240:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d750faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+15:14465:x1869066291768960:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 455us (632us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1782480930.556571:0:14240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00010000:00010000:2.0:1782480930.559469:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025094 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.559487:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025094 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.559494:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025094 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.559501:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2da00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:2.0:1782480930.559506:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025094 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.559514:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025094 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.559529:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:2.0:1782480930.559533:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480930.559537:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025094 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.559543:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2da00/0x3dc3ebf33c025094 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14240 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480930.565708:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480930.565961:0:14876:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291769088 00000100:00100000:0.0:1782480930.565971:0:14876:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291769088 00000100:00100000:0.0:1782480930.566030:0:14876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:0.0:1782480930.566041:0:14876:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4737ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+7:14465:x1869066291769088:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782480930.566060:0:14876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480930.566077:0:14876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c02509b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x441b2c9e73f3fd78 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.566106:0:14876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2e24077/0x3dc3ebf33c02508d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd71 expref: 8 pid: 14876 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.566114:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480930.566118:0:14876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480930.566122:0:14876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c02509b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd78 expref: 8 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.566166:0:14876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d2e24077/0x3dc3ebf33c02508d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd71 expref: 8 pid: 14876 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.566179:0:14876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d2e24077/0x3dc3ebf33c02508d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd71 expref: 8 pid: 14876 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480930.566212:0:14876:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48574000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14876:1869066311674624:192.168.204.51@tcp:104: 00000100:00100000:0.0:1782480930.566287:0:14876:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d453860c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480930.573100:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480930.573267:0:14223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291769216 00000100:00100000:2.0:1782480930.573277:0:14223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291769216 00010000:00010000:2.0:1782480930.573320:0:14223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d2e24077/0x3dc3ebf33c02508d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd71 expref: 9 pid: 14876 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480930.573388:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:2.0:1782480930.573398:0:14223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+9:2367:x1869066291769216:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480930.573412:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480930.573434:0:14223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d2e24077/0x3dc3ebf33c02508d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd71 expref: 9 pid: 14876 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.573448:0:14223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d2e24077/0x3dc3ebf33c02508d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd71 expref: 9 pid: 14876 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.573471:0:14223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480930.573476:0:14223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480930.573483:0:14223:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c02509b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd78 expref: 9 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.573493:0:14223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c02509b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd78 expref: 9 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.573532:0:14223:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c02509b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd78 expref: 9 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480930.573547:0:14223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4737a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14223:1869066311674752:192.168.204.51@tcp:105: 00010000:00010000:0.0:1782480930.573705:0:14876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2e24077/0x3dc3ebf33c02508d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd71 expref: 9 pid: 14876 timeout: 651 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480930.573722:0:14876:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48574000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14876:1869066311674624:192.168.204.51@tcp:104: 00010000:00010000:0.0:1782480930.574262:0:14876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c02509b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd78 expref: 8 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.574275:0:14876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b6d45d2c600, rc 0) 00000100:00100000:0.0:1782480930.574326:0:14876:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4737ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+8:14465:x1869066291769088:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 8287us (8628us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480930.574334:0:14876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:1.0:1782480930.576445:0:14223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f6ec780 going to sleep for 11 seconds 00000100:00100000:3.0:1782480930.579887:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480930.579971:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291769344 00000100:00100000:2.0:1782480930.579981:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291769344 00000100:00100000:2.0:1782480930.580048:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:2.0:1782480930.580058:0:14873:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+8:2367:x1869066291769344:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1782480930.580269:0:14873:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782480930.580272:0:14873:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1782480930 00002000:00010000:2.0:1782480930.580275:0:14873:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1782480929 00002000:00010000:2.0:1782480930.580277:0:14873:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1782480930 -> 1782480930 00002000:00010000:2.0:1782480930.580279:0:14873:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782480930.580387:0:14223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4737a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14223:1869066311674752:192.168.204.51@tcp:105: 00010000:00010000:1.0:1782480930.580407:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480930.581302:0:14873:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+9:2367:x1869066291769344:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 1242us (1420us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1782480930.581313:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:1.0:1782480930.581420:0:14223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7fc10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+8:2367:x1869066291769216:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 8022us (8329us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480930.581429:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:3.0:1782480930.584502:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480930.584661:0:16181:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291769472 00000100:00100000:2.0:1782480930.584671:0:16181:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291769472 00000100:00100000:2.0:1782480930.584982:0:16181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:2.0:1782480930.584993:0:16181:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f2d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec9c8cec-df0d-4fc3-b99c-4da053dab250+8:2366:x1869066291769472:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1782480930.585038:0:16181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c0250a2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.585059:0:16181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c02509b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd78 expref: 8 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.585068:0:16181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480930.585072:0:16181:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782480930.585077:0:16181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c0250a2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.585114:0:16181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c02509b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd78 expref: 8 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.585253:0:16181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c02509b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd78 expref: 8 pid: 14876 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480930.585269:0:16181:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4737a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16181:1869066311674880:192.168.204.51@tcp:104: 00000100:00100000:2.0:1782480930.585399:0:16181:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d7f6ec0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480930.589404:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480930.589478:0:14225:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291769600 00000100:00100000:1.0:1782480930.589487:0:14225:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291769600 00010000:00010000:1.0:1782480930.589525:0:14225:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c02509b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd78 expref: 9 pid: 14876 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480930.589561:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:1.0:1782480930.589571:0:14225:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48572a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+9:2366:x1869066291769600:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480930.589613:0:14225:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480930.589634:0:14225:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c02509b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd78 expref: 9 pid: 14876 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.589647:0:14225:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c02509b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd78 expref: 9 pid: 14876 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.589670:0:14225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782480930.589675:0:14225:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782480930.589681:0:14225:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c0250a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.589691:0:14225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c0250a2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.589713:0:14225:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782480930.590346:0:16181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c83e3cae/0x3dc3ebf33c02509b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd78 expref: 9 pid: 14876 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480930.590367:0:16181:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4737a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16181:1869066311674880:192.168.204.51@tcp:104: 00010000:00010000:2.0:1782480930.590390:0:16181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c0250a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.590401:0:16181:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c0250a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.590409:0:16181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c0250a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.590435:0:16181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c0250a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.590443:0:16181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c0250a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.590467:0:16181:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c0250a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.590474:0:16181:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e9800 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480930.590479:0:16181:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c0250a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.590489:0:16181:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c0250a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.590503:0:16181:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c0250a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.590511:0:16181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092d0c76d/0x3dc3ebf33c0250a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480930.590609:0:14225:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48572a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ec9c8cec-df0d-4fc3-b99c-4da053dab250+8:2366:x1869066291769600:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 1036us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480930.590618:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:2.0:1782480930.592507:0:16181:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f2d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ec9c8cec-df0d-4fc3-b99c-4da053dab250+7:2366:x1869066291769472:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 Request processed in 7506us (8003us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480930.592521:0:16181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:2.0:1782480930.595305:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480930.595387:0:14238:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291769856 00000100:00100000:1.0:1782480930.595398:0:14238:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291769856 00000100:00100000:1.0:1782480930.595460:0:14238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:1.0:1782480930.595469:0:14238:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4737a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+14:14465:x1869066291769856:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1782480930.595552:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c0250a9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.595569:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c0250a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.595606:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c0250a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.595907:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c0250b0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.595920:0:14238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c025078 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd63 expref: 15 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.595929:0:14238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c0250b0 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.595963:0:14238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c025078 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd63 expref: 15 pid: 15901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.595978:0:14238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c025078 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd63 expref: 15 pid: 15901 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480930.595993:0:14238:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14238:1869066311675008:192.168.204.51@tcp:104: 00000100:00100000:1.0:1782480930.596900:0:14238:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d6853e300 going to sleep for 11 seconds 00000100:00100000:2.0:1782480930.604035:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480930.604252:0:14223:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291769984 00000100:00100000:3.0:1782480930.604263:0:14223:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291769984 00010000:00010000:3.0:1782480930.604303:0:14223:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c025078 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd63 expref: 16 pid: 15901 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480930.604346:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:3.0:1782480930.604356:0:14223:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4737b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+16:2366:x1869066291769984:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480930.604370:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480930.604377:0:14223:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c025078 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd63 expref: 16 pid: 15901 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.604388:0:14223:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c025078 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd63 expref: 16 pid: 15901 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.604410:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:3.0:1782480930.604415:0:14223:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c0250b0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.604425:0:14223:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c0250b0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.604445:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c0250b0 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.604463:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480930.604518:0:14223:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4737b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+16:2366:x1869066291769984:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 163us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480930.604526:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00010000:00010000:1.0:1782480930.606259:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572c00/0x3dc3ebf33c025078 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd63 expref: 15 pid: 15901 timeout: 651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480930.606281:0:14238:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14238:1869066311675008:192.168.204.51@tcp:104: 00010000:00010000:1.0:1782480930.606304:0:14238:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c0250b0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.606315:0:14238:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c0250b0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.606333:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c0250b0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782480930.606510:0:14238:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1782480930.606726:0:14238:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1782480930.607236:0:14238:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1782480930.607328:0:14238:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14238:1869066311675136:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782480930.607550:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480930.607690:0:14238:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d6853ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480930.607797:0:14243:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311675136 00000100:00100000:3.0:1782480930.607804:0:14243:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311675136 00000100:00100000:3.0:1782480930.607859:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782480930.607869:0:14243:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d755dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14238:x1869066311675136:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1782480930.607952:0:14243:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d755dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14238:x1869066311675136:12345-0@lo:1000:mdt00_000.0 Request processed in 84us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480930.607960:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782480930.608182:0:14238:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14238:1869066311675136:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1782480930.608869:0:14238:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1782480930.608936:0:14238:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d755d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14238:1869066311675264:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782480930.608974:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480930.608990:0:14238:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d6853e300 going to sleep for 11 seconds 00000100:00100000:3.0:1782480930.609394:0:14243:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311675264 00000100:00100000:3.0:1782480930.609401:0:14243:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311675264 00000100:00100000:3.0:1782480930.609440:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782480930.609448:0:14243:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14238:x1869066311675264:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1782480930.609625:0:14243:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14238:x1869066311675264:12345-0@lo:1000:mdt00_000.0 Request processed in 177us (650us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1782480930.609633:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782480930.610353:0:14238:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d755d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14238:1869066311675264:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1782480930.610392:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c0250b0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.610402:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c0250b0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.610409:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c0250b0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.610416:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572600 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480930.610420:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c0250b0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.610442:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c0250b0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.610456:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:1.0:1782480930.610459:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782480930.610463:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c0250b0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.610469:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572600/0x3dc3ebf33c0250b0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.610497:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c025008 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.610503:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c025008 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.610508:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c025008 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.610512:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572e00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:1.0:1782480930.610514:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c025008 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.610519:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c025008 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.610524:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d4b781900) 00010000:00010000:1.0:1782480930.610526:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782480930.610532:0:14238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c02500f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd47 expref: 18 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.610552:0:14238:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c02500f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd47 expref: 18 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.610560:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c02500f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd47 expref: 18 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.610605:0:14238:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572400/0x3dc3ebf33c02500f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x441b2c9e73f3fd47 expref: 18 pid: 14240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480930.610668:0:14238:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7557bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14238:1869066311675392:192.168.204.51@tcp:105: 00000100:00100000:1.0:1782480930.610912:0:14238:0:(client.c:2701:ptlrpc_set_wait()) set ffff9b6d6853e300 going to sleep for 11 seconds 00000100:00100000:1.0:1782480930.615599:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480930.616232:0:14238:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7557bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14238:1869066311675392:192.168.204.51@tcp:105: 00010000:00010000:3.0:1782480930.616264:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c025008 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.616275:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e572e00/0x3dc3ebf33c025008 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15901 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.616328:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e600/0x3dc3ebf33c0250b7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.616341:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e600/0x3dc3ebf33c0250b7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.616353:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e600/0x3dc3ebf33c0250b7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.616362:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e600/0x3dc3ebf33c0250b7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.616368:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e600/0x3dc3ebf33c0250b7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.616374:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e600/0x3dc3ebf33c0250b7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480930.616525:0:14242:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291770112 00000100:00100000:0.0:1782480930.616534:0:14242:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291770112 00010000:00010000:3.0:1782480930.616607:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1e600 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480930.616611:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e600/0x3dc3ebf33c0250b7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.616619:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e600/0x3dc3ebf33c0250b7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.616632:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d4b781900) 00010000:00010000:3.0:1782480930.616635:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480930.616638:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e600/0x3dc3ebf33c0250b7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.616643:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6ef1e600/0x3dc3ebf33c0250b7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.616660:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c0250a9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.616666:0:14238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c0250a9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.616672:0:14238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c0250a9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.616677:0:14238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e573c00 already unused, calling callback (ffffffffc1f424f0) 00010000:00010000:3.0:1782480930.616680:0:14238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c0250a9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.616686:0:14238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c0250a9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.616694:0:14238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b6d4b781900) 00010000:00010000:3.0:1782480930.616696:0:14238:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782480930.616699:0:14238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c0250a9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.616705:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d6e573c00/0x3dc3ebf33c0250a9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14238 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480930.617078:0:14238:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4737a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+19:14465:x1869066291769856:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 21607us (21779us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1782480930.617089:0:14238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00000020:00080000:2.0:1782480930.617101:0:14238:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1782480930.617718:0:14271:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1782480930.617724:0:14271:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782480930.617796:0:14271:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1782480930.617803:0:14271:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1782480930.621513:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1782480930.621552:0:14241:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291770368 00000100:00100000:0.0:1782480930.621562:0:14241:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291770368 00000100:00100000:0.0:1782480930.621629:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:0.0:1782480930.621639:0:14241:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+19:14465:x1869066291770368:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1782480930.623471:0:14241:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1782480930.623610:0:14241:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1782480930.623673:0:14241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c0250be lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.623697:0:14241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c0250be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.623710:0:14241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c0250be lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.623720:0:14241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c0250be lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.623726:0:14241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c0250be lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.623732:0:14241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c0250be lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480930.623786:0:14241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782480930.624398:0:14227:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480930.624406:0:14227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c0250be lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.624436:0:14227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2c800 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:3.0:1782480930.624440:0:14227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c0250be lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.624449:0:14227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c0250be lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.624469:0:14227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b6d45d62100) 00010000:00010000:3.0:1782480930.624472:0:14227:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782480930.624476:0:14227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c0250be lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.624481:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b6d45d2c800/0x3dc3ebf33c0250be lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.624504:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480930.624506:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480930.624507:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480930.624947:0:14241:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+21:14465:x1869066291770368:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 3304us (3439us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1782480930.624958:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000020:00080000:0.0:1782480930.624965:0:14241:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782480930.625285:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:1.0:1782480930.625297:0:14242:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d473c5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+20:14464:x1869066291770112:12345-192.168.204.51@tcp:49:dd.0 00000100:00100000:1.0:1782480930.627758:0:14242:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d473c5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ec9c8cec-df0d-4fc3-b99c-4da053dab250+20:14464:x1869066291770112:12345-192.168.204.51@tcp:49:dd.0 Request processed in 2432us (12155us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480930.627772:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:0.0:1782480930.842369:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480930.842830:0:14879:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291770496 00000100:00100000:1.0:1782480930.842849:0:14879:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291770496 00000100:00100000:1.0:1782480930.842910:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:1.0:1782480930.842920:0:14879:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+7:2369:x1869066291770496:12345-192.168.204.51@tcp:4:dd.0 00002000:00010000:1.0:1782480930.842971:0:14879:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a3e8022, atime: 0x6a3e8021, ctime: 0x6a3e8022, blocks: 0x1 00010000:00010000:1.0:1782480930.842980:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043168c80/0x3dc3ebf33c0250c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.843006:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1782480930.843011:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480930.843016:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043168c80/0x3dc3ebf33c0250c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.843044:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043168c80/0x3dc3ebf33c0250c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480930.845219:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1782480930.845264:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480930.845483:0:14880:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1782480930.845492:0:14880:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1782480930.845511:0:14881:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1782480930.845529:0:14881:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291770624 00000100:00100000:0.0:1782480930.845537:0:14881:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291770624 00000100:00100000:0.0:1782480930.845590:0:14881:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1782480930.845596:0:14881:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291770752 00000100:00100000:0.0:1782480930.845598:0:14881:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291770752 00000100:00100000:1.0:1782480930.852743:0:16375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:1.0:1782480930.853669:0:16375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+10:2369:x1869066291770624:12345-192.168.204.51@tcp:4:dd.0 00010000:00010000:1.0:1782480930.853715:0:16375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dfae7c3/0x3dc3ebf33c0250cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.853732:0:16375:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480930.853736:0:16375:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480930.853743:0:16375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dfae7c3/0x3dc3ebf33c0250cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480930.853781:0:16375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006dfae7c3/0x3dc3ebf33c0250cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480930.861261:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480930.861396:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480930.861419:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480930.861471:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480930.861495:0:14880:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1782480930.861502:0:14880:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1782480930.862071:0:14881:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1782480930.862080:0:14881:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291770880 00000100:00100000:3.0:1782480930.862088:0:14881:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291770880 00000100:00100000:3.0:1782480930.862843:0:14881:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1782480930.862864:0:14881:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291771008 00000100:00100000:3.0:1782480930.862869:0:14881:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291771008 00000100:00100000:3.0:1782480930.862890:0:14881:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1782480930.862895:0:14881:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291771136 00000100:00100000:3.0:1782480930.862897:0:14881:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291771136 00000100:00100000:3.0:1782480930.862910:0:14881:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1782480930.862917:0:14881:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291771264 00000100:00100000:3.0:1782480930.862919:0:14881:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291771264 00000100:00100000:2.0:1782480930.864386:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1782480930.864887:0:14881:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1782480930.864900:0:14881:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291771392 00000100:00100000:1.0:1782480930.864908:0:14881:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291771392 00000100:00100000:3.0:1782480930.865285:0:16376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:3.0:1782480930.865297:0:16376:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d47379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ec9c8cec-df0d-4fc3-b99c-4da053dab250+16:2369:x1869066291770752:12345-192.168.204.51@tcp:4:dd.0 00010000:00010000:3.0:1782480930.865333:0:16376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c0250d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.865351:0:16376:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480930.865355:0:16376:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480930.865362:0:16376:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c0250d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480930.865377:0:16376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c0250d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782480930.960258:0:14879:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1782480930.960268:0:14879:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1782480930 -> 1782480931 00002000:00010000:2.0:1782480930.960271:0:14879:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1782480930 -> 1782480931 00002000:00010000:2.0:1782480930.960274:0:14879:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1782480930.960288:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043168c80/0x3dc3ebf33c0250c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.960302:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043168c80/0x3dc3ebf33c0250c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.960311:0:14879:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043168c80/0x3dc3ebf33c0250c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.960320:0:14879:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572600 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480930.960325:0:14879:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043168c80/0x3dc3ebf33c0250c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782480930.960328:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00010000:00010000:2.0:1782480930.960336:0:14879:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043168c80/0x3dc3ebf33c0250c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782480930.960352:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00010000:00010000:2.0:1782480930.960363:0:14879:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043168c80/0x3dc3ebf33c0250c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782480930.960366:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00010000:00010000:2.0:1782480930.960375:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043168c80/0x3dc3ebf33c0250c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480930.960481:0:14879:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+18:2369:x1869066291770496:12345-192.168.204.51@tcp:4:dd.0 Request processed in 117557us (118119us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1782480930.960495:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:2.0:1782480930.960526:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:2.0:1782480930.960537:0:14879:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+17:2368:x1869066291770880:12345-192.168.204.51@tcp:4:dd.0 00010000:00010000:2.0:1782480930.960579:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c0250da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.960591:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480930.960595:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480930.960601:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c0250da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480930.960613:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c0250da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782480931.026467:0:16375:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:0.0:1782480931.026477:0:16375:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:0.0:1782480931.026492:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dfae7c3/0x3dc3ebf33c0250cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480931.026519:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006dfae7c3/0x3dc3ebf33c0250cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480931.026529:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006dfae7c3/0x3dc3ebf33c0250cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480931.026537:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6e572c00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:0.0:1782480931.026542:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006dfae7c3/0x3dc3ebf33c0250cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480931.026552:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006dfae7c3/0x3dc3ebf33c0250cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480931.026585:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006dfae7c3/0x3dc3ebf33c0250cc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480931.026595:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dfae7c3/0x3dc3ebf33c0250cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480931.026689:0:16375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+19:2369:x1869066291770624:12345-192.168.204.51@tcp:4:dd.0 Request processed in 173033us (181474us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1782480931.026700:0:16375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:0.0:1782480931.026734:0:16375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000001:00080000:2.0:1782480931.026826:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:2.0:1782480931.026851:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000100:00100000:0.0:1782480931.027350:0:16375:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+18:2369:x1869066291771008:12345-192.168.204.51@tcp:4:dd.0 00010000:00010000:0.0:1782480931.027389:0:16375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0250e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480931.027409:0:16375:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480931.027414:0:16375:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480931.027421:0:16375:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0250e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480931.027433:0:16375:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0250e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782480931.036302:0:16376:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1782480931.036327:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c0250d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.036339:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c0250d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.036353:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c0250d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.036359:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1e800 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:3.0:1782480931.036363:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c0250d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.036371:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c0250d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.036388:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c0250d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.036395:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c0250d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480931.036498:0:16376:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d47379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ec9c8cec-df0d-4fc3-b99c-4da053dab250+13:2369:x1869066291770752:12345-192.168.204.51@tcp:4:dd.0 Request processed in 171199us (191228us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1782480931.036508:0:16376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:3.0:1782480931.036540:0:16376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:3.0:1782480931.036549:0:16376:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ec9c8cec-df0d-4fc3-b99c-4da053dab250+12:2368:x1869066291771136:12345-192.168.204.51@tcp:4:dd.0 00010000:00010000:3.0:1782480931.036594:0:16376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d9c24a9/0x3dc3ebf33c0250e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.036605:0:16376:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480931.036615:0:16376:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480931.036622:0:16376:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d9c24a9/0x3dc3ebf33c0250e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.036634:0:16376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d9c24a9/0x3dc3ebf33c0250e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782480931.081402:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:3.0:1782480931.084488:0:14879:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:3.0:1782480931.084500:0:14879:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:3.0:1782480931.084519:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c0250da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.084532:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c0250da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.084542:0:14879:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c0250da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.084550:0:14879:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d582e8400 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:3.0:1782480931.084555:0:14879:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c0250da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.084564:0:14879:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c0250da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.084597:0:14879:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c0250da lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.084619:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7cf1084/0x3dc3ebf33c0250da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480931.085025:0:14879:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+15:2368:x1869066291770880:12345-192.168.204.51@tcp:4:dd.0 Request processed in 124331us (223613us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1782480931.085037:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:3.0:1782480931.085074:0:14879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:3.0:1782480931.085085:0:14879:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+14:2369:x1869066291771264:12345-192.168.204.51@tcp:4:dd.0 00010000:00010000:3.0:1782480931.085119:0:14879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c0250ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.085132:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480931.085137:0:14879:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480931.085143:0:14879:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c0250ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.085157:0:14879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c0250ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.127171:0:16259:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782480931.127728:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:3.0:1782480931.128291:0:16376:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:3.0:1782480931.128297:0:16376:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:3.0:1782480931.128311:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d9c24a9/0x3dc3ebf33c0250e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.128341:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d9c24a9/0x3dc3ebf33c0250e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.128350:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d9c24a9/0x3dc3ebf33c0250e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.128358:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1e600 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:3.0:1782480931.128363:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d9c24a9/0x3dc3ebf33c0250e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.128373:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d9c24a9/0x3dc3ebf33c0250e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.128393:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d9c24a9/0x3dc3ebf33c0250e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.128402:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d9c24a9/0x3dc3ebf33c0250e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480931.128499:0:16376:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ec9c8cec-df0d-4fc3-b99c-4da053dab250+12:2368:x1869066291771136:12345-192.168.204.51@tcp:4:dd.0 Request processed in 91947us (267073us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1782480931.128509:0:16376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:3.0:1782480931.128541:0:16376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:3.0:1782480931.128553:0:16376:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d4737bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ec9c8cec-df0d-4fc3-b99c-4da053dab250+11:2369:x1869066291771392:12345-192.168.204.51@tcp:4:dd.0 00010000:00010000:3.0:1782480931.128594:0:16376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd024951/0x3dc3ebf33c0250f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.128613:0:16376:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480931.128618:0:16376:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480931.128623:0:16376:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd024951/0x3dc3ebf33c0250f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.128634:0:16376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd024951/0x3dc3ebf33c0250f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782480931.132243:0:16375:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1782480931.132263:0:16375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0250e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480931.132277:0:16375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0250e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480931.132300:0:16375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0250e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480931.132307:0:16375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d45d2d200 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:2.0:1782480931.132312:0:16375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0250e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480931.132320:0:16375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0250e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480931.132339:0:16375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0250e1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480931.132347:0:16375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000856a7d59/0x3dc3ebf33c0250e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480931.132436:0:16375:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+11:2369:x1869066291771008:12345-192.168.204.51@tcp:4:dd.0 Request processed in 105689us (271035us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1782480931.132447:0:16375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000001:00080000:3.0:1782480931.162549:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:0.0:1782480931.166122:0:14879:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1782480931.166132:0:14879:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1782480931.166146:0:14879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c0250ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480931.166158:0:14879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c0250ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480931.166167:0:14879:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c0250ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480931.166174:0:14879:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1e800 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:0.0:1782480931.166178:0:14879:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c0250ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480931.166188:0:14879:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c0250ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480931.166225:0:14879:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c0250ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480931.166233:0:14879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b4350b8/0x3dc3ebf33c0250ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480931.167574:0:14879:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+9:2369:x1869066291771264:12345-192.168.204.51@tcp:4:dd.0 Request processed in 82471us (306082us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1782480931.167588:0:14879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000001:00080000:2.0:1782480931.192678:0:7497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:3.0:1782480931.192982:0:16376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd024951/0x3dc3ebf33c0250f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.193047:0:16376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd024951/0x3dc3ebf33c0250f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.193058:0:16376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd024951/0x3dc3ebf33c0250f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.193075:0:16376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b6d6ef1fe00 already unused, calling callback (ffffffffc1506ce0) 00010000:00010000:3.0:1782480931.193080:0:16376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd024951/0x3dc3ebf33c0250f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.193089:0:16376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd024951/0x3dc3ebf33c0250f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.193108:0:16376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd024951/0x3dc3ebf33c0250f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.193127:0:16376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd024951/0x3dc3ebf33c0250f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480931.193238:0:16376:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d4737bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ec9c8cec-df0d-4fc3-b99c-4da053dab250+5:2369:x1869066291771392:12345-192.168.204.51@tcp:4:dd.0 Request processed in 64684us (328855us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1782480931.193249:0:16376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00010000:00010000:1.0:1782480932.152030:0:14226:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782480932.690383:0:16414:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1782480933.177958:0:14227:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480933.984119:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480933.984166:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480933.984197:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480933.984255:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480933.984274:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480933.984290:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480933.984306:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1782480933.984332:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291771776 00000100:00100000:3.0:1782480933.984341:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291771776 00000100:00100000:3.0:1782480933.984385:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291772288 00000100:00100000:3.0:1782480933.984387:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291772288 00000100:00100000:3.0:1782480933.984398:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291771904 00000100:00100000:3.0:1782480933.984399:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291771904 00000100:00100000:3.0:1782480933.984409:0:14873:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291772160 00000100:00100000:3.0:1782480933.984411:0:14873:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291772160 00000100:00100000:3.0:1782480933.984424:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:3.0:1782480933.984433:0:14873:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+5:2366:x1869066291771776:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480933.984499:0:14873:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+5:2366:x1869066291771776:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 66us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480933.984524:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:3.0:1782480933.984541:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:3.0:1782480933.984556:0:14873:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+5:2366:x1869066291772288:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480933.984583:0:14873:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48570a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+5:2366:x1869066291772288:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 28us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480933.984589:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:3.0:1782480933.984600:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:3.0:1782480933.984606:0:14873:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+5:2366:x1869066291771904:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480933.984628:0:14873:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec9c8cec-df0d-4fc3-b99c-4da053dab250+5:2366:x1869066291771904:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 23us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480933.984634:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:3.0:1782480933.984646:0:14873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:3.0:1782480933.984652:0:14873:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+5:2366:x1869066291772160:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480933.984687:0:14873:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+5:2366:x1869066291772160:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 35us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480933.984694:0:14873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:3.0:1782480933.984711:0:15901:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291772032 00000100:00100000:3.0:1782480933.984721:0:15901:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291772032 00000100:00100000:3.0:1782480933.984771:0:15901:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291771648 00000100:00100000:3.0:1782480933.984774:0:15901:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291771648 00000100:00100000:3.0:1782480933.984801:0:15901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:3.0:1782480933.984806:0:15901:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+6:2366:x1869066291772032:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480933.984836:0:15901:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9fa3cdb8-ed90-4062-a387-0c5cebb8035f+6:2366:x1869066291772032:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 29us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480933.984848:0:15901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:3.0:1782480933.984861:0:15901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:3.0:1782480933.984867:0:15901:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+20:2366:x1869066291771648:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1782480933.984908:0:15901:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec9c8cec-df0d-4fc3-b99c-4da053dab250+20:2366:x1869066291771648:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 40us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480933.984915:0:15901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00080000:3.0:1782480933.984941:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782480933.984945:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782480933.984947:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480933.985275:0:14233:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066291771520 00000100:00100000:0.0:1782480933.985280:0:14233:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066291771520 00000100:00100000:0.0:1782480933.985318:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:0.0:1782480933.985326:0:14233:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f31b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+13:2366:x1869066291771520:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1782480933.985372:0:14233:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f31b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9a33a5c0-4183-4286-a4af-4c77608d8db6+13:2366:x1869066291771520:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 47us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480933.985380:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:3.0:1782480934.134956:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311675520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480934.135031:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480934.135104:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d4737aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311675648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480934.135127:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480934.135211:0:14878:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311675520 00000100:00100000:1.0:1782480934.135226:0:14878:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311675520 00000100:00100000:2.0:1782480934.135239:0:14877:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311675648 00000100:00100000:2.0:1782480934.135242:0:14877:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311675648 00000100:00100000:1.0:1782480934.135317:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782480934.135326:0:14878:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311675520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782480934.135362:0:14878:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480934.135409:0:14878:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311675520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480934.135415:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782480934.135661:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311675904:0@lo:400:kworker.0 00000100:00100000:1.0:1782480934.135689:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480934.135710:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782480934.135716:0:3316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7557b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3316:1869066311675776:0@lo:400:kworker.0 00000100:00100000:1.0:1782480934.135767:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480934.135800:0:15901:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311675904 00000100:00100000:1.0:1782480934.135804:0:15901:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311675904 00000100:00100000:1.0:1782480934.135832:0:15901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782480934.135838:0:15901:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311675904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480934.135877:0:15901:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1869066311675904:12345-0@lo:400:kworker.0 Request processed in 38us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480934.135883:0:15901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1782480934.135909:0:14232:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311675776 00000100:00100000:1.0:1782480934.135913:0:14232:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311675776 00000100:00100000:1.0:1782480934.135934:0:14232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1782480934.135940:0:14232:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7f31b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:3316:x1869066311675776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480934.135963:0:14232:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7f31b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ed2e1d0c-2f63-46f9-ac79-60f348db465e+19:3316:x1869066311675776:12345-0@lo:400:kworker.0 Request processed in 23us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480934.135969:0:14232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1782480934.136009:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7557b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ed2e1d0c-2f63-46f9-ac79-60f348db465e:3316:1869066311675776:0@lo:400:kworker.0 00000100:00100000:1.0:1782480934.136030:0:3316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3316:1869066311675904:0@lo:400:kworker.0 00000100:00100000:1.0:1782480934.136056:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d7557a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311676160:0@lo:400:kworker.0 00000100:00100000:1.0:1782480934.136078:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480934.136108:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d48571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311675520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480934.136120:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782480934.136125:0:3318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9b6d75578e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1869066311676032:0@lo:400:kworker.0 00000100:00100000:1.0:1782480934.136146:0:3318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480934.136171:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311676160 00000100:00100000:1.0:1782480934.136174:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311676160 00000100:00100000:2.0:1782480934.140037:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782480934.140123:0:14877:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d48572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311675648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782480934.140168:0:14877:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1782480934.140268:0:14877:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d48572680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1869066311675648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 219us (5139us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480934.140276:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782480934.140339:0:3318:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1782480934.140345:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b6d75540000, transno 8589934595 00000004:00080000:2.0:1782480934.140356:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1782480934.140385:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d4737aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3318:1869066311675648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480934.142470:0:14240:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066311676032 00000100:00100000:1.0:1782480934.142483:0:14240:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066311676032 00000100:00080000:3.0:1782480934.142995:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782480934.143001:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782480934.143004:0:14234:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480934.143625:0:15901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782480934.143639:0:15901:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d75579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869066311676160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480934.145001:0:15901:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d75579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1869066311676160:12345-0@lo:400:kworker.0 Request processed in 1360us (8914us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480934.145014:0:15901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782480934.145153:0:15901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782480934.145167:0:15901:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff9b6d7557b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869066311676032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480934.145214:0:15901:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff9b6d7557b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1869066311676032:12345-0@lo:400:kworker.0 Request processed in 52us (9066us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480934.145229:0:15901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782480934.145294:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d75578e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3318:1869066311676032:0@lo:400:kworker.0 00000100:00100000:0.0:1782480934.145309:0:3318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9b6d7557a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3318:1869066311676160:0@lo:400:kworker.0 00010000:00010000:3.0:1782480934.200051:0:16259:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29704 lines, 29704 kept, 0 dropped, 0 bad.